00000001:02000400:3.0F:1789478246.550545:0:3300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing set_hostid 00000001:02000400:3.0:1789478265.294108:0:3521:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1789478267.277006:0:3582:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1179 MB/s 00000001:01000000:0.0F:1789478267.527247:0:3582:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1471 MB/s 00000001:01000000:3.0:1789478267.776792:0:3582:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 7963 MB/s 00000020:02000000:3.0:1789478268.185212:0:3614:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_84_gd41d3c6 00000400:02000000:0.0:1789478268.780282:0:3629:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.111@tcp [8/256/0/180] 00008000:02000000:0.0:1789478272.125443:0:3778:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1789478320.323359:0:5744:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789478331.851837:0:6494:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789478331.851843:0:6494:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1789478331.851845:0:6494:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789478331.851990:0:6494:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000001639ebce 00000080:02000400:0.0:1789478331.852000:0:6494:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1789478331.860618:0:6494:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1789478331.860629:0:6494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789478331.860652:0:6494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000004bba1f93) 00000020:00000080:0.0:1789478331.860667:0:6494:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789478331.930385:0:6494:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1789478331.931579:0:6494:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0F:1789478331.954087:0:6494:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789478331.954489:0:6494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789478331.954497:0:6494:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789478331.954507:0:6494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ebaae74e82158a9 00000020:01000004:2.0:1789478331.954514:0:6494:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789478331.954518:0:6494:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789478331.954522:0:6494:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001639ebce from MGS 00000020:01000004:2.0:1789478331.954525:0:6494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789478331.954543:0:6494:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000001d42042c) 00000020:00000080:2.0:1789478331.954553:0:6494:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789478331.954924:0:6494:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001639ebce from MGS, refs=2 00080000:01000000:2.0:1789478331.954931:0:6494:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789478331.954936:0:6494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ebaae74e82158b7 00000100:00100000:2.0:1789478331.955030:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789478331.955158:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789478331.955165:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789478331.956050:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789478331.956058:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789478331.957115:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789478331.957379:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789478331.957386:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789478331.958161:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789478331.958169:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789478331.958706:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789478331.958713:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789478331.959556:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478331.959558:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478331.959560:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478331.959995:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478331.959998:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478331.959999:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478331.960586:0:6494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789478331.962049:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1789478332.210786:0:6494:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2719 MB/s 00000001:01000000:2.0:1789478332.460771:0:6494:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5091 MB/s 00000001:01000000:0.0:1789478332.711396:0:6494:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 843 MB/s 00000001:01000000:3.0:1789478332.965132:0:6494:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 795 MB/s 00010000:00010000:1.0:1789478332.966001:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1789478332.975852:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1789478332.996979:0:6494:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1789478333.000047:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789478333.000110:0:6494:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789478333.000156:0:6494:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1789478333.000334:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789478333.000355:0:6494:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789478333.000728:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789478333.000885:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789478333.000892:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789478333.001816:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789478333.001824:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789478333.002178:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789478333.002185:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789478333.006440:0:6494:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789478333.006466:0:6494:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.111@tcp' 00000020:01000004:2.0:1789478333.006468:0:6494:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789478333.006522:0:6494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.111@tcp (typ=mgc) 00000020:00000080:2.0:1789478333.006534:0:6494:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.111@tcp (000000005d4a9d5f) 00000020:00000080:2.0:1789478333.006548:0:6494:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789478333.006671:0:6494:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a31c2f71@MGC192.168.206.111@tcp: add connection 192.168.206.111@tcp at head 00010000:00010000:2.0:1789478333.006809:0:6494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.111@tcp-0 is initialized 00000040:01000000:2.0:1789478333.006814:0:6494:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 1 is initialized 00000100:00080000:2.0:1789478333.007205:0:6513:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789478333.011387:0:6514:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789478333.011433:0:6494:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.111@tcp (uuid c56e5039-4535-4d8a-bd01-962355b55f9c) 00000020:00000080:2.0:1789478333.011454:0:6494:0:(genops.c:1385:class_connect()) connect: client c56e5039-4535-4d8a-bd01-962355b55f9c, cookie 0x8ebaae74e82158c5 00000100:00080000:2.0:1789478333.011466:0:6494:0:(import.c:510:import_select_connection()) MGC192.168.206.111@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789478333.011476:0:6494:0:(import.c:625:import_select_connection()) MGC192.168.206.111@tcp: import 00000000a31c2f71 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1789478333.011583:0:6494:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000025762d2 x1876403964346496/t0(0) o250->MGC192.168.206.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789478333.018883:0:6494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c56e5039-4535-4d8a-bd01-962355b55f9c->MGS 00000020:01000004:2.0:1789478333.018993:0:6494:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789478333.019001:0:6494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789478333.019013:0:6494:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000078797a9c) 00000020:00000080:2.0:1789478333.019030:0:6494:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789478333.019817:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000025762d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c56e5039-4535-4d8a-bd01-962355b55f9c:3644:1876403964346496:0@lo:250: 00000100:00100000:0.0:1789478333.019891:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478333.026806:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964346496 00000100:00100000:3.0:1789478333.026817:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964346496 00000100:00100000:3.0:1789478333.027691:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789478333.027698:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000822df1e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1876403964346496:12345-0@lo:250: 00010000:00080000:3.0:1789478333.027726:0:6510:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c56e5039-4535-4d8a-bd01-962355b55f9c@0@lo t0 exp 0000000000000000 cur 162 last 0 00000020:00000080:3.0:1789478333.027752:0:6510:0:(genops.c:1385:class_connect()) connect: client c56e5039-4535-4d8a-bd01-962355b55f9c, cookie 0x8ebaae74e82158d3 00000100:00080000:3.0:1789478333.027878:0:6510:0:(import.c:65:import_set_state_nolock()) 0000000063bb90d9 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789478333.036859:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789478333.037720:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789478333.037727:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789478333.040666:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000822df1e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+5:3644:x1876403964346496:12345-0@lo:250: Request processed in 12961us (20769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478333.040680:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789478333.040759:0:3644:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.111@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789478333.040769:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) MGC192.168.206.111@tcp: connect to target with instance 0 00000100:00080000:3.0:1789478333.040776:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) MGC192.168.206.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789478333.040780:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789478333.040783:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000a31c2f71 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789478333.040786:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789478333.040794:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789478333.040798:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000025762d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c56e5039-4535-4d8a-bd01-962355b55f9c:3644:1876403964346496:0@lo:250: 00000100:00100000:3.0:1789478333.041580:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789478333.041630:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789478333.050789:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789478333.050890:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789478333.054316:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789478333.054588:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789478333.054630:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789478333.056788:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789478333.056800:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789478333.143831:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789478333.144010:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789478333.144024:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789478333.146916:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789478333.146929:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789478333.147906:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789478333.148074:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789478333.148079:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789478333.148922:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789478333.148929:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789478333.149543:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789478333.149946:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789478333.149951:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789478333.150466:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789478333.150472:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789478333.151094:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789478333.151304:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789478333.151309:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789478333.152005:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789478333.152011:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789478333.167031:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789478333.167316:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789478333.167324:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789478333.172960:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789478333.172974:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789478333.173965:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789478333.173973:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789478333.174785:0:6494:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789478333.174812:0:6494:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1789478333.174817:0:6494:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789478333.174905:0:6494:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789478333.174934:0:6494:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.111@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789478333.174939:0:6494:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789478333.174940:0:6494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789478333.174942:0:6494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789478333.174943:0:6494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789478333.174948:0:6494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789478333.174950:0:6494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789478333.174951:0:6494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789478333.174952:0:6494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789478333.174953:0:6494:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789478333.174954:0:6494:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789478333.174955:0:6494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789478333.174956:0:6494:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789478333.174958:0:6494:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789478333.174960:0:6494:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789478333.174961:0:6494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789478333.174962:0:6494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789478333.174963:0:6494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789478333.174964:0:6494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789478333.174964:0:6494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789478333.174965:0:6494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789478333.174966:0:6494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789478333.174967:0:6494:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789478333.174968:0:6494:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789478333.174968:0:6494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789478333.174969:0:6494:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789478333.174999:0:6494:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789478333.175013:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e303881a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964346624:0@lo:253: 00000100:00100000:3.0:1789478333.175078:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478333.175181:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c3175cab going to sleep for 11 seconds 00000100:00100000:1.0:1789478333.175318:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964346624 00000100:00100000:1.0:1789478333.175325:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964346624 00000100:00100000:1.0:1789478333.175412:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789478333.175421:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044732950 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+5:6494:x1876403964346624:12345-0@lo:253: 20000000:01000000:1.0:1789478333.175465:0:6512:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789478333.175468:0:6512:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1789478333.175767:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789478333.175815:0:6512:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789478333.176106:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789478333.177350:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789478333.177543:0:6512:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789478333.177547:0:6512:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789478333.177551:0:6512:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789478333.177554:0:6512:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789478333.177564:0:6512:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789478333.180638:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789478333.180790:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789478333.180805:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789478333.180835:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789478333.180852:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789478333.180866:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789478333.180932:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789478333.180941:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789478333.180954:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789478333.180960:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789478333.180971:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789478333.180975:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789478333.180987:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789478333.181002:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789478333.181027:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789478333.181031:0:6512:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789478333.181037:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789478333.181133:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789478333.181142:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789478333.181155:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789478333.181281:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789478333.181308:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789478333.181318:0:6512:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789478333.181339:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789478333.181346:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789478333.181356:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789478333.181367:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789478333.181378:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789478333.181385:0:6512:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789478333.181402:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789478333.181408:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789478333.181419:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789478333.181431:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789478333.181473:0:6512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789478333.181489:0:6512:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789478333.181495:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789478333.181983:0:6535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789478333.182157:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789478333.182240:0:6512:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.111@tcp for mdt 20000000:01000000:1.0:1789478333.182248:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.111@tcp (null) (null) (null) 00000040:00080000:1.0:1789478333.182277:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789478333.182283:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789478333.182294:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789478333.182298:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.111@tcp (null) (null) 00000040:00080000:1.0:1789478333.182306:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789478333.182312:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789478333.182322:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789478333.182335:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789478333.182358:0:6512:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789478333.182361:0:6512:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789478333.182364:0:6512:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789478333.182400:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789478333.182402:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789478333.182774:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789478333.182923:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789478333.182942:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789478333.182969:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1789478333.182981:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789478333.182983:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789478333.183359:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1789478333.183502:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1789478333.183521:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1789478333.183536:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1789478333.183546:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789478333.183548:0:6512:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1789478333.183552:0:6512:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789478333.183554:0:6512:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789478333.183558:0:6512:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789478333.183563:0:6512:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789478333.184092:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1789478333.184275:0:6512:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1789478333.192378:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1789478333.192426:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1789478333.192442:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1789478333.192459:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789478333.192478:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e53c13e4/0x8ebaae74e82158da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.192493:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e53c13e4/0x8ebaae74e82158da lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.192502:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e53c13e4/0x8ebaae74e82158da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.192508:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e53c13e4/0x8ebaae74e82158da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.192513:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e53c13e4/0x8ebaae74e82158da lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.192518:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e53c13e4/0x8ebaae74e82158da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.192524:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e53c13e4 already unused, calling callback (00000000d680f8d5) 00010000:00010000:1.0:1789478333.192526:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e53c13e4/0x8ebaae74e82158da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.192532:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e53c13e4/0x8ebaae74e82158da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.192542:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e53c13e4/0x8ebaae74e82158da lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.192548:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e53c13e4/0x8ebaae74e82158da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.192564:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e53c13e4/0x8ebaae74e82158da lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789478333.192582:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789478333.204663:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044732950 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+5:6494:x1876403964346624:12345-0@lo:253: Request processed in 29237us (29578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478333.204677:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789478333.204914:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e303881a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964346624:0@lo:253: 10000000:01000000:3.0:1789478333.204929:0:6494:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789478333.204931:0:6494:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789478333.204933:0:6494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789478333.204934:0:6494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789478333.204945:0:6494:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789478333.204947:0:6494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789478333.204948:0:6494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789478333.204949:0:6494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789478333.204950:0:6494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789478333.204952:0:6494:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789478333.204953:0:6494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789478333.204954:0:6494:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789478333.204973:0:6494:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001639ebce from lustre-MDT0000 10000000:01000000:3.0:1789478333.204999:0:6494:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789478333.205002:0:6494:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789478333.205006:0:6494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8ebc08d93370 10000000:01000000:3.0:1789478333.205009:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789478333.205015:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ebc08d93370 from 1 10000000:01000000:3.0:1789478333.205018:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789478333.205119:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 00000000a368f21b/0x8ebaae74e82158e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478333.205130:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 00000000a368f21b/0x8ebaae74e82158e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478333.205139:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 00000000a368f21b/0x8ebaae74e82158e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478333.205156:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e303881a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964346752:0@lo:101: 00000100:00100000:3.0:1789478333.205191:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478333.205308:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964346752 00000100:00100000:2.0:1789478333.205314:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964346752 00000100:00100000:2.0:1789478333.205345:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789478333.205352:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038c37bd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+5:6494:x1876403964346752:12345-0@lo:101: 00010000:00010000:2.0:1789478333.205363:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478333.205374:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000063a2ef82/0x8ebaae74e82158e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e82158e1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478333.205400:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000063a2ef82/0x8ebaae74e82158e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e82158e1 expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478333.205409:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000063a2ef82/0x8ebaae74e82158e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e82158e1 expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478333.205417:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000063a2ef82, rc 0) 00000100:00100000:2.0:1789478333.205459:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038c37bd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+6:6494:x1876403964346752:12345-0@lo:101: Request processed in 108us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478333.205464:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789478333.205527:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e93feb2e going to sleep for 11 seconds 00000100:00100000:3.0:1789478333.205539:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e303881a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964346752:0@lo:101: 00010000:00010000:3.0:1789478333.205548:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 00000000a368f21b/0x8ebaae74e82158e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82158e8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478333.205555:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 00000000a368f21b/0x8ebaae74e82158e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e82158e8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478333.205640:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e303881a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964346880:0@lo:501: 00000100:00100000:3.0:1789478333.205661:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478333.205902:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964346880 00000100:00100000:1.0:1789478333.205907:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964346880 00000100:00100000:1.0:1789478333.205926:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789478333.205931:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6cf7db5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+6:6494:x1876403964346880:12345-0@lo:501: 00000100:00100000:1.0:1789478333.205987:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6cf7db5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+6:6494:x1876403964346880:12345-0@lo:501: Request processed in 56us (325us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789478333.205993:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789478333.206202:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e93feb2e going to sleep for 11 seconds 00000100:00100000:3.0:1789478333.206215:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e303881a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964346880:0@lo:501: 10000000:01000000:3.0:1789478333.206238:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789478333.206291:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 00000000a368f21b/0x8ebaae74e82158e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82158e8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478333.206299:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 00000000a368f21b/0x8ebaae74e82158e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82158e8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478333.206306:0:6494:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ebc0501d800 10000000:01000000:3.0:1789478333.206310:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789478333.206313:0:6494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ebc0501d800 10000000:01000000:3.0:1789478333.206315:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789478333.206318:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ebc0501d800 from 1 10000000:01000000:3.0:1789478333.206320:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789478333.206333:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 0000000058737b15/0x8ebaae74e82158ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478333.206339:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 0000000058737b15/0x8ebaae74e82158ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478333.206345:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 0000000058737b15/0x8ebaae74e82158ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478333.206354:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e303881a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964347008:0@lo:101: 00000100:00100000:3.0:1789478333.206382:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478333.206430:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e93feb2e going to sleep for 11 seconds 00000100:00100000:1.0:1789478333.206476:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964347008 00000100:00100000:1.0:1789478333.206480:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964347008 00000100:00100000:1.0:1789478333.206532:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789478333.206538:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006bb0b998 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+6:6494:x1876403964347008:12345-0@lo:101: 00010000:00010000:1.0:1789478333.206545:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478333.206553:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e53c13e4/0x8ebaae74e82158f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e82158ef expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.206574:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e53c13e4/0x8ebaae74e82158f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e82158ef expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.206581:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e53c13e4/0x8ebaae74e82158f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e82158ef expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.206725:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e53c13e4, rc 0) 00000100:00100000:1.0:1789478333.206895:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006bb0b998 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+7:6494:x1876403964347008:12345-0@lo:101: Request processed in 357us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478333.206901:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789478333.206974:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e303881a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964347008:0@lo:101: 00010000:00010000:3.0:1789478333.206983:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 0000000058737b15/0x8ebaae74e82158ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82158f6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478333.206990:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 0000000058737b15/0x8ebaae74e82158ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e82158f6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478333.207000:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789478333.207013:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 0000000058737b15/0x8ebaae74e82158ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82158f6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478333.207019:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 0000000058737b15/0x8ebaae74e82158ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82158f6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478333.207024:0:6494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789478333.207028:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789478333.207031:0:6494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ebc0501d800 10000000:01000000:3.0:1789478333.207033:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789478333.207035:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789478333.207037:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789478333.207151:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 00000000c1347a0e/0x8ebaae74e82158fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478333.207158:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 00000000c1347a0e/0x8ebaae74e82158fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478333.207165:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 00000000c1347a0e/0x8ebaae74e82158fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478333.207180:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e303881a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964347136:0@lo:101: 00000100:00100000:3.0:1789478333.207202:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478333.207225:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e93feb2e going to sleep for 11 seconds 00000100:00100000:0.0:1789478333.207277:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964347136 00000100:00100000:0.0:1789478333.207282:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964347136 00000100:00100000:0.0:1789478333.207308:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789478333.207312:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5796097 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+7:6494:x1876403964347136:12345-0@lo:101: 00010000:00010000:0.0:1789478333.207319:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478333.207331:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000060f398c2/0x8ebaae74e8215904 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e82158fd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478333.207343:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000060f398c2/0x8ebaae74e8215904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e82158fd expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478333.207350:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000060f398c2/0x8ebaae74e8215904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e82158fd expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478333.207356:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000060f398c2, rc 0) 00000100:00100000:0.0:1789478333.207386:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5796097 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+8:6494:x1876403964347136:12345-0@lo:101: Request processed in 75us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478333.207391:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789478333.207474:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e303881a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964347136:0@lo:101: 00010000:00010000:3.0:1789478333.207483:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 00000000c1347a0e/0x8ebaae74e82158fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215904 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478333.207489:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 00000000c1347a0e/0x8ebaae74e82158fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215904 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478333.207525:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e303881a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964347264:0@lo:501: 00000100:00100000:3.0:1789478333.207545:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478333.207680:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e93feb2e going to sleep for 11 seconds 00000100:00100000:0.0:1789478333.207837:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964347264 00000100:00100000:0.0:1789478333.207841:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964347264 00000100:00100000:0.0:1789478333.207865:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789478333.207870:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046dd987e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+8:6494:x1876403964347264:12345-0@lo:501: 00000100:00100000:0.0:1789478333.207956:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046dd987e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+9:6494:x1876403964347264:12345-0@lo:501: Request processed in 85us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478333.207961:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789478333.208042:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e303881a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964347264:0@lo:501: 00000100:00100000:3.0:1789478333.208133:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e303881a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964347392:0@lo:503: 00000100:00100000:3.0:1789478333.208165:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478333.208184:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e93feb2e going to sleep for 11 seconds 00000100:00100000:0.0:1789478333.208222:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964347392 00000100:00100000:0.0:1789478333.208226:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964347392 00000100:00100000:0.0:1789478333.208320:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789478333.208333:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065f85621 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+9:6494:x1876403964347392:12345-0@lo:503: 00000100:00100000:0.0:1789478333.208412:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065f85621 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+9:6494:x1876403964347392:12345-0@lo:503: Request processed in 79us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478333.208418:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789478333.208646:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e303881a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964347392:0@lo:503: 00000100:00100000:3.0:1789478333.209224:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e303881a pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:6539:1876403964347520:0@lo:502: 00000100:00100000:3.0:1789478333.209272:0:6539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478333.209301:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ca1055cd going to sleep for 11 seconds 00000100:00100000:0.0:1789478333.209348:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964347520 00000100:00100000:0.0:1789478333.209353:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964347520 00000100:00100000:0.0:1789478333.209392:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789478333.209398:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006834ce01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+9:6539:x1876403964347520:12345-0@lo:502: 00000100:00100000:0.0:1789478333.209517:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006834ce01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+9:6539:x1876403964347520:12345-0@lo:502: Request processed in 119us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478333.209524:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789478333.209853:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e303881a pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:6539:1876403964347520:0@lo:502: 00000020:01000000:3.0:1789478333.209878:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789478333.209887:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478333.209894:0:6539:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789478333.209899:0:6539:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789478333.209902:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789478333.209918:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000c6f9d6ec) 00000020:00000080:3.0:1789478333.209935:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789478333.209940:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789478333.210007:0:6539:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789478333.210015:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ebaae74e8215912 00000020:00000080:3.0:1789478333.210308:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789478333.210313:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789478333.210318:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478333.210319:0:6539:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789478333.210322:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789478333.210325:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478333.210327:0:6539:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789478333.210330:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789478333.210337:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000035b0e3dc) 00000020:00000080:3.0:1789478333.210347:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789478333.210350:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789478333.210352:0:6539:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789478333.210354:0:6539:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789478333.210360:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789478333.210394:0:6539:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001639ebce from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789478333.210406:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000083dcb37d) 00000020:00000080:3.0:1789478333.210423:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789478333.210502:0:6539:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789478333.210507:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8ebaae74e8215927 00000020:00000080:3.0:1789478333.210867:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789478333.210875:0:6539:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789478333.210879:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8ebaae74e821592e 00080000:01000000:3.0:1789478333.210885:0:6539:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789478333.210888:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ebaae74e8215935 00080000:10000000:3.0:1789478333.211580:0:6539:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1789478333.211953:0:6539:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789478333.220364:0:6539:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1789478333.301989:0:6539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1789478333.302324:0:6539:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1789478333.304430:0:6539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789478333.304808:0:6539:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789478333.313387:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000dc6fcd10) 00000020:00000080:1.0:1789478333.313718:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789478333.313840:0:6539:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789478333.313847:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ebaae74e8215943 00000020:00000080:0.0:1789478333.317123:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1789478333.317990:0:6539:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1789478333.324808:0:6539:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1789478333.333524:0:6539:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1789478333.336557:0:6539:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1789478333.356927:0:6539:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1789478333.361002:0:6539:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1789478333.364918:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8ebaae74e821594a 00000020:00000080:2.0:1789478333.368228:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789478333.368239:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789478333.368247:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478333.368260:0:6539:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789478333.368263:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789478333.368267:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478333.368269:0:6539:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789478333.368272:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789478333.368273:0:6539:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789478333.368276:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789478333.368278:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478333.368279:0:6539:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789478333.368281:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789478333.368285:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478333.368286:0:6539:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789478333.368289:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789478333.368342:0:6539:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1789478333.368529:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0a93f71 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:6539:1876403964347648:0@lo:502: 00000100:00100000:2.0:1789478333.368629:0:6539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478333.368678:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set 0000000065ee164f going to sleep for 11 seconds 00000100:00100000:0.0:1789478333.368848:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964347648 00000100:00100000:0.0:1789478333.368855:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964347648 00000100:00100000:0.0:1789478333.368905:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789478333.368913:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bea30630 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+9:6539:x1876403964347648:12345-0@lo:502: 00000100:00100000:0.0:1789478333.369034:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bea30630 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+9:6539:x1876403964347648:12345-0@lo:502: Request processed in 121us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478333.369042:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789478333.369339:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0a93f71 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:6539:1876403964347648:0@lo:502: 00000020:01000000:2.0:1789478333.369564:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789478333.369571:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478333.369573:0:6539:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1789478333.369576:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1789478333.370643:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1789478333.370667:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789478333.370689:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 00000000c1347a0e/0x8ebaae74e82158fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215904 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478333.370701:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 00000000c1347a0e/0x8ebaae74e82158fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215904 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478333.370709:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ebc0501d800 from 1 10000000:01000000:0.0:1789478333.370713:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789478333.370773:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 0000000084a27830/0x8ebaae74e8215951 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478333.370781:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 0000000084a27830/0x8ebaae74e8215951 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478333.370796:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 0000000084a27830/0x8ebaae74e8215951 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478333.370814:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b5541fd pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964347776:0@lo:101: 00000100:00100000:0.0:1789478333.370861:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478333.370902:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061c83bb0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478333.371059:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964347776 00000100:00100000:2.0:1789478333.371066:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964347776 00000100:00100000:2.0:1789478333.371118:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789478333.371126:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006363a053 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+9:6494:x1876403964347776:12345-0@lo:101: 00010000:00010000:2.0:1789478333.371137:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478333.371148:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007c1ae027/0x8ebaae74e8215958 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215951 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478333.371166:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007c1ae027/0x8ebaae74e8215958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215951 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478333.371176:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007c1ae027/0x8ebaae74e8215958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215951 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478333.371185:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007c1ae027, rc 0) 00000100:00100000:2.0:1789478333.371229:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006363a053 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+10:6494:x1876403964347776:12345-0@lo:101: Request processed in 104us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478333.371236:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789478333.371329:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b5541fd pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964347776:0@lo:101: 00010000:00010000:0.0:1789478333.371341:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 0000000084a27830/0x8ebaae74e8215951 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215958 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478333.371348:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 0000000084a27830/0x8ebaae74e8215951 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215958 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478333.372712:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b5541fd pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964347904:0@lo:256: 00000100:00100000:0.0:1789478333.372831:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478333.372906:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061c83bb0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478333.374203:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964347904 00000100:00100000:2.0:1789478333.374214:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964347904 00000100:00100000:2.0:1789478333.374400:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789478333.374409:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f15ada89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+10:6494:x1876403964347904:12345-0@lo:256: 20000000:01000000:2.0:1789478333.374430:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789478333.374435:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789478333.374892:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f15ada89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+10:6494:x1876403964347904:12345-0@lo:256: Request processed in 484us (2060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478333.374901:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789478333.375016:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b5541fd pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964347904:0@lo:256: 10000000:01000000:0.0:1789478333.376048:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789478333.376125:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 0000000084a27830/0x8ebaae74e8215951 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215958 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478333.376138:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 0000000084a27830/0x8ebaae74e8215951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215958 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478333.376146:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebc0501d800 from 1 10000000:01000000:0.0:1789478333.376148:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789478333.376184:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 00000000ab8a91c8/0x8ebaae74e821595f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478333.376191:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 00000000ab8a91c8/0x8ebaae74e821595f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478333.376200:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 00000000ab8a91c8/0x8ebaae74e821595f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478333.376216:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b5541fd pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964348032:0@lo:101: 00000100:00100000:0.0:1789478333.376267:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478333.376306:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061c83bb0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478333.377033:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964348032 00000100:00100000:2.0:1789478333.377040:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964348032 00000100:00100000:2.0:1789478333.377089:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789478333.377107:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ffadd06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+10:6494:x1876403964348032:12345-0@lo:101: 00010000:00010000:2.0:1789478333.377119:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478333.377132:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005372202c/0x8ebaae74e8215966 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e821595f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478333.377152:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005372202c/0x8ebaae74e8215966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e821595f expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478333.377162:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005372202c/0x8ebaae74e8215966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e821595f expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478333.377170:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005372202c, rc 0) 00000100:00100000:2.0:1789478333.377207:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ffadd06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+11:6494:x1876403964348032:12345-0@lo:101: Request processed in 112us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478333.377214:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789478333.377404:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b5541fd pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964348032:0@lo:101: 00010000:00010000:0.0:1789478333.377416:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 00000000ab8a91c8/0x8ebaae74e821595f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215966 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478333.377424:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 00000000ab8a91c8/0x8ebaae74e821595f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215966 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478333.377531:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b5541fd pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964348160:0@lo:501: 00000100:00100000:0.0:1789478333.377557:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478333.377584:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061c83bb0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478333.377677:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964348160 00000100:00100000:2.0:1789478333.377681:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964348160 00000100:00100000:2.0:1789478333.377702:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789478333.377706:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008907f321 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+11:6494:x1876403964348160:12345-0@lo:501: 00000100:00100000:2.0:1789478333.378724:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008907f321 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+11:6494:x1876403964348160:12345-0@lo:501: Request processed in 1014us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478333.378734:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789478333.378840:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b5541fd pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964348160:0@lo:501: 00000100:00100000:3.0:1789478333.378873:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e303881a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964348288:0@lo:503: 00000100:00100000:3.0:1789478333.378915:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478333.378942:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 00000000275ea58d going to sleep for 11 seconds 00000100:00100000:1.0:1789478333.378952:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964348288 00000100:00100000:1.0:1789478333.378957:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964348288 00000100:00100000:1.0:1789478333.378994:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789478333.379001:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce2aeeb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+11:6494:x1876403964348288:12345-0@lo:503: 00000040:00080000:1.0:1789478333.379040:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789478333.379085:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce2aeeb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+11:6494:x1876403964348288:12345-0@lo:503: Request processed in 85us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478333.379092:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789478333.379221:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e303881a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964348288:0@lo:503: 00000040:00080000:2.0:1789478333.380987:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1789478333.381194:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789478333.381216:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789478333.381290:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 00000000ab8a91c8/0x8ebaae74e821595f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215966 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478333.381304:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 00000000ab8a91c8/0x8ebaae74e821595f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215966 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478333.381348:0:6494:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789478333.381351:0:6494:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ebc0501d800 10000000:01000000:3.0:1789478333.381353:0:6494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ebc0501d800 10000000:01000000:3.0:1789478333.381357:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789478333.381362:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ebc0501d800 from 1 10000000:01000000:3.0:1789478333.381364:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789478333.381461:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 00000000c3159528/0x8ebaae74e821596d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478333.381471:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 00000000c3159528/0x8ebaae74e821596d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478333.381480:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 00000000c3159528/0x8ebaae74e821596d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478333.381515:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e303881a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964348416:0@lo:101: 00000100:00100000:3.0:1789478333.381763:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478333.381802:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 000000001cad37eb going to sleep for 11 seconds 00000100:00100000:0.0:1789478333.381861:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964348416 00000100:00100000:0.0:1789478333.381867:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964348416 00000100:00100000:0.0:1789478333.381955:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789478333.381964:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065a46ac4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+11:6494:x1876403964348416:12345-0@lo:101: 00010000:00010000:0.0:1789478333.381975:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478333.381986:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000072891110/0x8ebaae74e8215974 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e821596d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478333.382017:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000072891110/0x8ebaae74e8215974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e821596d expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478333.382025:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000072891110/0x8ebaae74e8215974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e821596d expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478333.382033:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000072891110, rc 0) 00000100:00100000:0.0:1789478333.382087:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065a46ac4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+12:6494:x1876403964348416:12345-0@lo:101: Request processed in 125us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478333.382093:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789478333.382161:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e303881a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964348416:0@lo:101: 00010000:00010000:3.0:1789478333.382175:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 00000000c3159528/0x8ebaae74e821596d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215974 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478333.382183:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 00000000c3159528/0x8ebaae74e821596d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215974 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478333.382234:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e303881a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964348544:0@lo:501: 00000100:00100000:3.0:1789478333.382268:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478333.383895:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 000000001cad37eb going to sleep for 11 seconds 00000100:00100000:1.0:1789478333.383961:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964348544 00000100:00100000:1.0:1789478333.383970:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964348544 00000100:00100000:1.0:1789478333.384009:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789478333.384017:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bceb0a8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+12:6494:x1876403964348544:12345-0@lo:501: 00000100:00100000:1.0:1789478333.384350:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bceb0a8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+12:6494:x1876403964348544:12345-0@lo:501: Request processed in 333us (2081us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478333.384368:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789478333.384510:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e303881a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964348544:0@lo:501: 00000100:00100000:0.0:1789478333.384562:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001dc0e421 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964348672:0@lo:503: 00000100:00100000:0.0:1789478333.384617:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478333.384639:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 0000000072116755 going to sleep for 11 seconds 00000100:00100000:1.0:1789478333.384834:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964348672 00000100:00100000:1.0:1789478333.384839:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964348672 00000100:00100000:1.0:1789478333.384871:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789478333.384877:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044748a60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+12:6494:x1876403964348672:12345-0@lo:503: 00000100:00100000:1.0:1789478333.384951:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044748a60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+12:6494:x1876403964348672:12345-0@lo:503: Request processed in 74us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478333.384958:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789478333.385044:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001dc0e421 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964348672:0@lo:503: 00000100:00100000:1.0:1789478333.385911:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017e8b6c5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:6544:1876403964348800:0@lo:502: 00000100:00100000:1.0:1789478333.385949:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478333.385976:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f949eaa5 going to sleep for 11 seconds 00000100:00100000:0.0:1789478333.385990:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964348800 00000100:00100000:0.0:1789478333.385995:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964348800 00000100:00100000:0.0:1789478333.386029:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789478333.386037:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000013b8d8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+12:6544:x1876403964348800:12345-0@lo:502: 00000100:00100000:0.0:1789478333.386128:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000013b8d8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+12:6544:x1876403964348800:12345-0@lo:502: Request processed in 92us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478333.386135:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789478333.386149:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017e8b6c5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:6544:1876403964348800:0@lo:502: 00000020:01000004:2.0:1789478333.386200:0:6544:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789478333.386213:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000008b7e6453) 00000020:00000080:2.0:1789478333.386230:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789478333.386310:0:6544:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001639ebce from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789478333.386314:0:6544:0:(tgt_mount.c:187:server_put_mount()) put mount 000000001639ebce from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789478333.386317:0:6544:0:(obd_mount.c:710:lustre_put_lsi()) put 000000001639ebce 4 00010000:00080000:2.0:1789478333.386343:0:6544:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000064304ab5@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.111@tcp at head 00010000:00010000:2.0:1789478333.389275:0:6544:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789478333.390921:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789478333.390994:0:6544:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789478333.391005:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8ebaae74e8215982 00000100:00080000:2.0:1789478333.391015:0:6544:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789478333.391024:0:6544:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000064304ab5 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1789478333.392173:0:6544:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d0a93f71 x1876403964348928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789478333.392205:0:6544:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789478333.392847:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0a93f71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876403964348928:0@lo:38: 00000100:00100000:3.0:1789478333.392914:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478333.393210:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001dc0e421 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:6544:1876403964349056:0@lo:502: 00000100:00100000:0.0:1789478333.393261:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478333.393296:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964349056 00000100:00100000:0.0:1789478333.393306:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964349056 00000100:00100000:0.0:1789478333.393343:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789478333.393350:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008598e01c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+12:6544:x1876403964349056:12345-0@lo:502: 00000100:00100000:2.0:1789478333.394023:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964348928 00000100:00100000:2.0:1789478333.394030:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964348928 00000100:00100000:2.0:1789478333.394056:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789478333.394061:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096874529 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876403964348928:12345-0@lo:38: 00000100:00100000:2.0:1789478333.394185:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096874529 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876403964348928:12345-0@lo:38: Request processed in 123us (1271us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789478333.394202:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789478333.394319:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789478333.394326:0:3644:0:(import.c:65:import_set_state_nolock()) 0000000064304ab5 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789478333.394330:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789478333.394333:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0a93f71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876403964348928:0@lo:38: 00000100:00100000:0.0:1789478333.394368:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008598e01c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+12:6544:x1876403964349056:12345-0@lo:502: Request processed in 1018us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478333.394376:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789478333.394420:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set 0000000090509051 going to sleep for 11 seconds 00000100:00100000:0.0:1789478333.394433:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001dc0e421 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:6544:1876403964349056:0@lo:502: 00000040:00080000:0.0:1789478333.394456:0:6544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1789478333.394981:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1789478333.395001:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789478333.395021:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 00000000c3159528/0x8ebaae74e821596d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215974 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478333.395031:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 00000000c3159528/0x8ebaae74e821596d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215974 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789478333.395072:0:6494:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789478333.395074:0:6494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789478333.395075:0:6494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478333.395076:0:6494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478333.395078:0:6494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478333.395079:0:6494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478333.395080:0:6494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789478333.395082:0:6494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789478333.395083:0:6494:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789478333.395084:0:6494:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789478333.395086:0:6494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478333.395087:0:6494:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789478333.395090:0:6494:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1789478333.395093:0:6494:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789478333.395094:0:6494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789478333.395095:0:6494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478333.395095:0:6494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478333.395096:0:6494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478333.395097:0:6494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478333.395098:0:6494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789478333.395104:0:6494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789478333.395105:0:6494:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789478333.395106:0:6494:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789478333.395107:0:6494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478333.395108:0:6494:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789478333.395125:0:6494:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789478333.395135:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0a93f71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964349184:0@lo:253: 00000100:00100000:2.0:1789478333.395180:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478333.395246:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d9dd7968 going to sleep for 11 seconds 00000100:00100000:3.0:1789478333.399356:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964349184 00000100:00100000:3.0:1789478333.399368:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964349184 00000100:00100000:3.0:1789478333.399428:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789478333.399436:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d76c93d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+12:6494:x1876403964349184:12345-0@lo:253: 20000000:01000000:3.0:1789478333.399728:0:6512:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789478333.399804:0:6512:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789478333.413737:0:6512:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789478333.413755:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789478333.413822:0:6533:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789478333.413828:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789478333.413847:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fa3328be/0x8ebaae74e8215989 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478333.413865:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007c1ae027/0x8ebaae74e8215958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215951 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478333.413880:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000fa3328be/0x8ebaae74e8215989 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478333.413912:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007c1ae027/0x8ebaae74e8215958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215951 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478333.413926:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007c1ae027/0x8ebaae74e8215958 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215951 expref: 12 pid: 6510 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478333.413940:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000098cfa039 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1876403964349312:0@lo:104: 00000100:00100000:3.0:1789478333.413994:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478333.414045:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set 000000007472f143 going to sleep for 11 seconds 00000100:00100000:0.0:1789478333.414213:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964349312 00000100:00100000:0.0:1789478333.414219:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964349312 00000100:00100000:0.0:1789478333.414289:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789478333.414413:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019f7ecd3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+3:6533:x1876403964349312:12345-0@lo:104: 00010000:00010000:0.0:1789478333.414424:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: 0000000084a27830/0x8ebaae74e8215951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215958 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478333.414476:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789478333.414482:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019f7ecd3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+3:6533:x1876403964349312:12345-0@lo:104: Request processed in 73us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478333.414627:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d76c93d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+12:6494:x1876403964349184:12345-0@lo:253: Request processed in 15192us (19447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478333.414634:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789478333.414853:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789478333.414861:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789478333.414867:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: 0000000084a27830/0x8ebaae74e8215951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215958 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.414875:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000084a27830 already unused, calling callback (00000000ec062f3f) 10000000:00010000:1.0:1789478333.414879:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: 0000000084a27830/0x8ebaae74e8215951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215958 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.414887:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: 0000000084a27830/0x8ebaae74e8215951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215958 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478333.414893:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: 0000000084a27830/0x8ebaae74e8215951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215958 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478333.414895:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000098cfa039 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1876403964349312:0@lo:104: 10000000:01000000:1.0:1789478333.414906:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789478333.414919:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000fa3328be/0x8ebaae74e8215989 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.414942:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: 0000000084a27830/0x8ebaae74e8215951 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215958 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.414959:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789478333.414979:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: 0000000084a27830/0x8ebaae74e8215951 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215958 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.414984:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: 0000000084a27830/0x8ebaae74e8215951 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215958 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.415001:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478333.415003:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478333.415005:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478333.415031:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789478333.415042:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff41740e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964349440:0@lo:103: 00000100:00100000:3.0:1789478333.415076:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478333.415114:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964349440 00000100:00100000:1.0:1789478333.415119:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964349440 00010000:00010000:1.0:1789478333.415137:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007c1ae027/0x8ebaae74e8215958 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215951 expref: 12 pid: 6510 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478333.415169:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789478333.415177:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065b365e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+12:3645:x1876403964349440:12345-0@lo:103: 00010000:00010000:1.0:1789478333.415187:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478333.415191:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007c1ae027/0x8ebaae74e8215958 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215951 expref: 12 pid: 6510 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.415201:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007c1ae027/0x8ebaae74e8215958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215951 expref: 12 pid: 6510 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.415213:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007c1ae027/0x8ebaae74e8215958 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215951 expref: 12 pid: 6510 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.415225:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000fa3328be/0x8ebaae74e8215989 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.415239:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fa3328be/0x8ebaae74e8215989 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789478333.415260:0:6502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001433271s 00010000:00010000:1.0:1789478333.415263:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fa3328be/0x8ebaae74e8215989 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.415269:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fa3328be/0x8ebaae74e8215989 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.415273:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fa3328be/0x8ebaae74e8215989 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.415277:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fa3328be/0x8ebaae74e8215989 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.415281:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fa3328be already unused, calling callback (00000000d680f8d5) 00010000:00010000:1.0:1789478333.415283:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fa3328be/0x8ebaae74e8215989 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.415299:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fa3328be/0x8ebaae74e8215989 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.415318:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fa3328be/0x8ebaae74e8215989 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478333.415326:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789478333.415388:0:6533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000fa3328be/0x8ebaae74e8215989 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478333.415408:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fa3328be/0x8ebaae74e8215989 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478333.415555:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fa3328be/0x8ebaae74e8215989 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478333.415941:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0a93f71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:6494:1876403964349184:0@lo:253: 10000000:01000000:2.0:1789478333.415954:0:6494:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789478333.415957:0:6494:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789478333.415959:0:6494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789478333.415960:0:6494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478333.415962:0:6494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478333.415963:0:6494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478333.415964:0:6494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478333.415966:0:6494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789478333.415967:0:6494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789478333.415968:0:6494:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789478333.415969:0:6494:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789478333.415971:0:6494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478333.415972:0:6494:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789478333.415982:0:6494:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789478333.420273:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065b365e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+11:3645:x1876403964349440:12345-0@lo:103: Request processed in 5089us (5187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478333.420289:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789478333.421544:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff41740e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964349440:0@lo:103: 00080000:10000000:0.0:1789478333.428137:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1789478333.428320:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789478333.429850:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1789478333.430058:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789478333.430819:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1789478333.431046:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1789478333.433679:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1789478333.433855:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1789478333.434069:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1789478333.434243:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1789478333.436090:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1789478333.436265:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1789478333.449484:0:6494:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1789478333.458310:0:6494:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789478333.458473:0:6549:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789478333.458477:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789478333.458743:0:6550:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789478333.460062:0:6494:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789478333.460181:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789478333.460676:0:6494:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789478333.460683:0:6494:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789478333.460777:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789478333.461767:0:6494:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789478333.465936:0:6494:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789478333.465985:0:6494:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789478333.466521:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789478333.466900:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:0.0:1789478333.467246:0:6550:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:3.0:1789478333.469071:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789478333.469207:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789478333.469374:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789478333.469510:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789478333.470746:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789478333.470953:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789478333.471152:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789478333.471304:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789478333.471442:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789478333.471577:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789478333.471784:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789478333.471923:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789478333.472060:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789478333.472197:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789478333.472361:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00000040:00080000:0.0:1789478333.474235:0:6550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789478333.474331:0:6550:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789478333.474341:0:6550:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1789478333.474812:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789478333.475941:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789478333.477309:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789478333.478314:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789478333.479347:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789478333.479719:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789478333.479872:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789478333.480355:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789478333.480575:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789478333.480797:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789478333.480986:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789478333.481566:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789478333.481769:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789478333.481901:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789478333.482038:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789478333.482669:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789478333.482898:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789478333.484064:0:6494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1789478333.490286:0:6494:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789478333.490326:0:6494:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9dd901c9b988 00100000:10000000:2.0:1789478333.490334:0:6494:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789478333.491011:0:6494:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789478333.491026:0:6494:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.111@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789478333.491059:0:6494:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789478333.491074:0:6494:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1789478333.494788:0:6494:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789478333.495011:0:6494:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789478333.989711:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478335.013881:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478336.036742:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478337.062789:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789478337.204031:0:6794:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:0.0:1789478338.065252:0:6846:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789478338.065441:0:6846:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789478338.086853:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789478338.788971:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789478338.788982:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789478338.789007:0:37:0:(import.c:65:import_set_state_nolock()) 0000000064304ab5 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789478338.789024:0:37:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000064304ab5 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1789478338.789048:0:37:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005488293a x1876403964349696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789478338.789099:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005488293a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876403964349696:0@lo:38: 00000100:00100000:0.0:1789478338.789162:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478338.789252:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964349696 00000100:00100000:2.0:1789478338.789261:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964349696 00000100:00100000:2.0:1789478338.789309:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789478338.789323:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebf47700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876403964349696:12345-0@lo:38: 00010000:00080000:2.0:1789478338.789345:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:2.0:1789478338.789375:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8ebaae74e8215990 00000100:00100000:3.0:1789478338.789479:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001dc0e421 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964349568:0@lo:400: 00000004:00100000:2.0:1789478338.790168:0:6519:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789478338.790787:0:6519:0:(import.c:65:import_set_state_nolock()) 00000000e9b16146 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789478338.790838:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478338.790979:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964349568 00000100:00100000:1.0:1789478338.790986:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964349568 00000100:00100000:1.0:1789478338.791019:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789478338.791066:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebca8396 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+11:3647:x1876403964349568:12345-0@lo:400: 00000100:00100000:1.0:1789478338.791131:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebca8396 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+11:3647:x1876403964349568:12345-0@lo:400: Request processed in 69us (1616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478338.791138:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789478338.791192:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001dc0e421 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964349568:0@lo:400: 00000100:00100000:2.0:1789478338.791448:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebf47700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876403964349696:12345-0@lo:38: Request processed in 2125us (2286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478338.791454:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789478338.791728:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005488293a x1876403964349696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789478348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789478338.791743:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789478338.791751:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789478338.791756:0:3644:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789478338.791759:0:3644:0:(import.c:65:import_set_state_nolock()) 0000000064304ab5 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789478338.791764:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005488293a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876403964349696:0@lo:38: 00010000:00010000:3.0:1789478339.108838:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789478339.300971:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789478339.300978:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ebc0501d800 from 3 10000000:01000000:3.0:1789478339.300983:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789478339.301024:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 00000000fe1e6f0d/0x8ebaae74e8215997 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478339.301035:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 00000000fe1e6f0d/0x8ebaae74e8215997 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478339.301043:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 00000000fe1e6f0d/0x8ebaae74e8215997 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478339.301064:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001199868f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964349824:0@lo:101: 00000100:00100000:3.0:1789478339.301126:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478339.301199:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ffcc3080 going to sleep for 11 seconds 00000100:00100000:0.0:1789478339.301695:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964349824 00000100:00100000:0.0:1789478339.301704:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964349824 00000100:00100000:0.0:1789478339.301750:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789478339.301758:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1fdf82d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+11:6514:x1876403964349824:12345-0@lo:101: 00010000:00010000:0.0:1789478339.301771:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478339.301784:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000084a27830/0x8ebaae74e821599e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215997 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478339.301804:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000084a27830/0x8ebaae74e821599e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215997 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478339.301813:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000084a27830/0x8ebaae74e821599e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215997 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478339.301820:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000084a27830, rc 0) 00000100:00100000:0.0:1789478339.301872:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1fdf82d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+12:6514:x1876403964349824:12345-0@lo:101: Request processed in 115us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478339.301879:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789478339.302024:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001199868f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964349824:0@lo:101: 00010000:00010000:3.0:1789478339.302039:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 00000000fe1e6f0d/0x8ebaae74e8215997 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e821599e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478339.302046:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 00000000fe1e6f0d/0x8ebaae74e8215997 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e821599e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478339.302092:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001199868f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964349952:0@lo:256: 00000100:00100000:3.0:1789478339.302122:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478339.302152:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ffcc3080 going to sleep for 11 seconds 00000100:00100000:0.0:1789478339.302206:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964349952 00000100:00100000:0.0:1789478339.302211:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964349952 00000100:00100000:0.0:1789478339.302286:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789478339.302306:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000074b6817 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+12:6514:x1876403964349952:12345-0@lo:256: 20000000:01000000:0.0:1789478339.302330:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789478339.302344:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789478339.302346:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789478339.302441:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000074b6817 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+12:6514:x1876403964349952:12345-0@lo:256: Request processed in 149us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478339.302447:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789478339.302516:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001199868f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964349952:0@lo:256: 10000000:01000000:1.0:1789478339.302554:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789478339.302569:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 00000000fe1e6f0d/0x8ebaae74e8215997 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e821599e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478339.302576:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 00000000fe1e6f0d/0x8ebaae74e8215997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e821599e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478340.132767:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789478340.371792:0:6948:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789478340.372046:0:6948:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789478341.156819:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478342.180781:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478343.207507:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478343.909485:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789478343.909508:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000949bfc5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964350080:0@lo:400: 00000100:00100000:3.0:1789478343.909570:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478343.909643:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007ba8c038 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964350208:0@lo:400: 00000100:00100000:3.0:1789478343.909669:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478343.909708:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964350208 00000100:00100000:3.0:1789478343.909715:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964350208 00000100:00100000:3.0:1789478343.909758:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789478343.909767:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005200b777 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964350208:12345-0@lo:400: 00000100:00100000:3.0:1789478343.909814:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005200b777 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964350208:12345-0@lo:400: Request processed in 49us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478343.909821:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789478343.909827:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007ba8c038 x1876403964350208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478343.909840:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007ba8c038 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964350208:0@lo:400: 00000100:00100000:1.0:1789478343.910222:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964350080 00000100:00100000:1.0:1789478343.910228:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964350080 00000100:00100000:1.0:1789478343.910263:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789478343.910270:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000867bd07c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+12:3647:x1876403964350080:12345-0@lo:400: 00000100:00100000:1.0:1789478343.910315:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000867bd07c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+12:3647:x1876403964350080:12345-0@lo:400: Request processed in 46us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478343.910320:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789478343.910883:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000949bfc5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964350080:0@lo:400: 00010000:00010000:1.0:1789478344.228918:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478345.252833:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478346.277214:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478347.306423:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789478347.864852:0:7446:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789478347.864856:0:7446:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789478347.864857:0:7446:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789478347.865003:0:7446:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000024a94445 00000020:01000004:0.0:1789478347.865018:0:7446:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1789478347.865041:0:7446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789478347.865053:0:7446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000000b1ac064) 00000020:00000080:0.0:1789478347.865067:0:7446:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789478347.941193:0:7446:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1789478347.941263:0:7446:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1789478347.973513:0:7446:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789478347.973965:0:7446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789478347.973977:0:7446:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789478347.973987:0:7446:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8ebaae74e82159ac 00000020:01000004:0.0:1789478347.973993:0:7446:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789478347.974012:0:7446:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.111@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789478347.974014:0:7446:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789478347.974020:0:7446:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789478347.974193:0:7446:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789478347.974197:0:7446:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.111@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789478347.992502:0:7446:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789478347.992540:0:7446:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.111@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1789478347.992544:0:7446:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789478347.992546:0:7446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789478347.992547:0:7446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478347.992548:0:7446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478347.992549:0:7446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478347.992551:0:7446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478347.992552:0:7446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789478347.992553:0:7446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789478347.992554:0:7446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789478347.992555:0:7446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478347.992557:0:7446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789478347.992559:0:7446:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1789478347.992561:0:7446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789478347.992563:0:7446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789478347.992564:0:7446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478347.992564:0:7446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478347.992571:0:7446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478347.992572:0:7446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478347.992572:0:7446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789478347.992573:0:7446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789478347.992574:0:7446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789478347.992575:0:7446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478347.992575:0:7446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789478347.993010:0:7446:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789478347.993134:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0a93f71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964350336:0@lo:253: 00000100:00100000:2.0:1789478347.993208:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478347.993310:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e89c51cd going to sleep for 11 seconds 00000100:00100000:0.0:1789478347.993389:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964350336 00000100:00100000:0.0:1789478347.993402:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964350336 00000100:00100000:0.0:1789478347.993486:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789478347.993494:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000c09457 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+12:7446:x1876403964350336:12345-0@lo:253: 20000000:01000000:0.0:1789478347.993521:0:6511:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789478347.993525:0:6511:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1789478347.993530:0:6511:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1789478347.993533:0:6511:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1789478347.993564:0:6511:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1789478347.993803:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789478347.993933:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789478347.993945:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789478347.993960:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1789478347.993973:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1789478347.993984:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1789478347.994046:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1789478347.994054:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1789478347.994073:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1789478347.994079:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1789478347.994090:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1789478347.994094:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1789478347.994104:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1789478347.994118:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1789478347.994220:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1789478347.994229:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.111@tcp (null) (null) (null) 00000040:00080000:0.0:1789478347.994243:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1789478347.994248:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789478347.994261:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1789478347.994266:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.206.111@tcp (null) (null) 00000040:00080000:0.0:1789478347.994291:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1789478347.994297:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789478347.994310:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1789478347.994335:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1789478347.994345:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1789478347.994412:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1789478347.994420:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1789478347.994430:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1789478347.994442:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1789478347.994456:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1789478347.994461:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1789478347.994472:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1789478347.994489:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1789478347.994493:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1789478347.994509:0:6511:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789478347.994514:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1789478347.999459:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1789478348.000614:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789478348.000640:0:6511:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.111@tcp for mdt 20000000:01000000:0.0:1789478348.000642:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.111@tcp (null) (null) (null) 00000040:00080000:0.0:1789478348.000672:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789478348.000683:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789478348.000698:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789478348.000703:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.206.111@tcp (null) (null) 00000040:00080000:0.0:1789478348.000720:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789478348.000727:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1789478348.000740:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1789478348.000754:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1789478348.000803:0:6511:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1789478348.000811:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1789478348.003891:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1789478348.004073:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1789478348.004098:0:6511:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.206.111@tcp for mdt 20000000:01000000:2.0:1789478348.004100:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.111@tcp (null) (null) (null) 00000040:00080000:2.0:1789478348.004115:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1789478348.004123:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789478348.004135:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1789478348.004140:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.206.111@tcp (null) (null) 00000040:00080000:2.0:1789478348.004151:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1789478348.004157:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1789478348.004168:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1789478348.004193:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1789478348.004216:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789478348.004219:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789478348.004223:0:6511:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789478348.004484:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789478348.004486:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789478348.004779:0:7454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1789478348.004799:0:7454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1789478348.004812:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1789478348.004997:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1789478348.005017:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1789478348.005582:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1789478348.005673:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789478348.005676:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789478348.006220:0:7455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1789478348.006335:0:7455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1789478348.006363:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1789478348.009470:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1789478348.009515:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1789478348.009533:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1789478348.009546:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789478348.009549:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789478348.010196:0:7456:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1789478348.010216:0:7456:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1789478348.010305:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789478348.010490:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789478348.010508:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789478348.010527:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1789478348.010538:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789478348.010540:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789478348.010544:0:6511:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789478348.010550:0:6511:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789478348.011171:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1789478348.011341:0:6511:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789478348.026165:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789478348.026209:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000002eb86c8/0x8ebaae74e82159b3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.026227:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000063a2ef82/0x8ebaae74e82158e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e82158e1 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.026233:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000060f398c2/0x8ebaae74e8215904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e82158fd expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.026239:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000072891110/0x8ebaae74e8215974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e821596d expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.026246:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000002eb86c8/0x8ebaae74e82159b3 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.026283:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000072891110/0x8ebaae74e8215974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e821596d expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.026314:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000072891110/0x8ebaae74e8215974 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e821596d expref: 12 pid: 6510 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478348.026327:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075a0138a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1876403964350464:0@lo:104: 00000100:00100000:2.0:1789478348.026382:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789478348.026472:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000060f398c2/0x8ebaae74e8215904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e82158fd expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.026480:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000060f398c2/0x8ebaae74e8215904 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e82158fd expref: 12 pid: 6511 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478348.026488:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d433a213 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1876403964350592:0@lo:104: 00000100:00100000:2.0:1789478348.026508:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789478348.029883:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000063a2ef82/0x8ebaae74e82158e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e82158e1 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.029902:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000063a2ef82/0x8ebaae74e82158e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e82158e1 expref: 12 pid: 6510 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478348.029916:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f78ec8cc pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1876403964350720:0@lo:104: 00000100:00100000:2.0:1789478348.029963:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478348.030370:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964350464 00000100:00100000:0.0:1789478348.030377:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964350464 00000100:00100000:3.0:1789478348.030537:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964350592 00000100:00100000:2.0:1789478348.030537:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 0000000069a038d9 going to sleep for 11 seconds 00000100:00100000:3.0:1789478348.030554:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964350592 00000100:00100000:3.0:1789478348.030571:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964350720 00000100:00100000:3.0:1789478348.030573:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964350720 00000100:00100000:1.0:1789478348.030626:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789478348.030642:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004bd30cdd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+5:6511:x1876403964350464:12345-0@lo:104: 00010000:00010000:1.0:1789478348.030654:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: 00000000c3159528/0x8ebaae74e821596d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215974 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.030719:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789478348.030724:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004bd30cdd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+5:6511:x1876403964350464:12345-0@lo:104: Request processed in 91us (4343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478348.030784:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075a0138a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1876403964350464:0@lo:104: 00010000:00010000:0.0:1789478348.031739:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789478348.031746:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: 00000000c3159528/0x8ebaae74e821596d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215974 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.031754:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c3159528 already unused, calling callback (00000000ec062f3f) 10000000:00010000:0.0:1789478348.031757:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: 00000000c3159528/0x8ebaae74e821596d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215974 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.031765:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: 00000000c3159528/0x8ebaae74e821596d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215974 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478348.031771:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: 00000000c3159528/0x8ebaae74e821596d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215974 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478348.031776:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789478348.031849:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: 00000000c3159528/0x8ebaae74e821596d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215974 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.031856:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478348.031871:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: 00000000c3159528/0x8ebaae74e821596d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215974 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.031877:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: 00000000c3159528/0x8ebaae74e821596d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215974 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.031901:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478348.031902:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478348.031904:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478348.031917:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fef39b6a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964350848:0@lo:103: 00000100:00100000:0.0:1789478348.031960:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478348.032718:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964350848 00000100:00100000:2.0:1789478348.032727:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964350848 00010000:00010000:2.0:1789478348.032751:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000072891110/0x8ebaae74e8215974 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e821596d expref: 13 pid: 6510 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478348.032799:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789478348.032806:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8d4b4e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+13:3646:x1876403964350848:12345-0@lo:103: 00010000:00010000:2.0:1789478348.032817:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478348.032821:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000072891110/0x8ebaae74e8215974 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e821596d expref: 13 pid: 6510 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.032831:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000072891110/0x8ebaae74e8215974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e821596d expref: 13 pid: 6510 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.032844:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000072891110/0x8ebaae74e8215974 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e821596d expref: 13 pid: 6510 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.032857:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478348.032899:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8d4b4e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+12:3646:x1876403964350848:12345-0@lo:103: Request processed in 95us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478348.032906:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789478348.032942:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fef39b6a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964350848:0@lo:103: 00000100:00100000:1.0:1789478348.038031:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789478348.038077:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789478348.038093:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7a72481 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+4:6511:x1876403964350592:12345-0@lo:104: 00010000:00010000:1.0:1789478348.038110:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: 00000000c1347a0e/0x8ebaae74e82158fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215904 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.038239:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789478348.038382:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7a72481 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+4:6511:x1876403964350592:12345-0@lo:104: Request processed in 160us (11736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478348.038390:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789478348.038406:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789478348.038412:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e32a835 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+3:6511:x1876403964350720:12345-0@lo:104: 00010000:00010000:1.0:1789478348.038420:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: 00000000a368f21b/0x8ebaae74e82158e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e82158e8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.038534:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789478348.038539:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e32a835 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+3:6511:x1876403964350720:12345-0@lo:104: Request processed in 128us (8577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478348.038545:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789478348.038567:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789478348.038572:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: 00000000c1347a0e/0x8ebaae74e82158fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215904 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.038579:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c1347a0e already unused, calling callback (00000000ec062f3f) 10000000:00010000:1.0:1789478348.038582:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: 00000000c1347a0e/0x8ebaae74e82158fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215904 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.038589:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: 00000000c1347a0e/0x8ebaae74e82158fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215904 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478348.038619:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: 00000000c1347a0e/0x8ebaae74e82158fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215904 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478348.038624:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789478348.038729:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: 00000000c1347a0e/0x8ebaae74e82158fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215904 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.038736:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789478348.038754:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: 00000000c1347a0e/0x8ebaae74e82158fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215904 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.038760:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: 00000000c1347a0e/0x8ebaae74e82158fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215904 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.038773:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789478348.038775:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: 00000000a368f21b/0x8ebaae74e82158e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e82158e8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.038780:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a368f21b already unused, calling callback (00000000ec062f3f) 10000000:00010000:1.0:1789478348.038782:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: 00000000a368f21b/0x8ebaae74e82158e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e82158e8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.038788:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: 00000000a368f21b/0x8ebaae74e82158e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e82158e8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478348.038793:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: 00000000a368f21b/0x8ebaae74e82158e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e82158e8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478348.038797:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789478348.038808:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: 00000000a368f21b/0x8ebaae74e82158e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e82158e8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.038813:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789478348.038817:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: 00000000a368f21b/0x8ebaae74e82158e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e82158e8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478348.038828:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d433a213 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1876403964350592:0@lo:104: 00010000:00010000:1.0:1789478348.038832:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: 00000000a368f21b/0x8ebaae74e82158e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e82158e8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478348.038838:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f78ec8cc pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1876403964350720:0@lo:104: 00010000:00010000:1.0:1789478348.038844:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478348.038846:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478348.038847:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478348.038858:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000002eb86c8/0x8ebaae74e82159b3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478348.038937:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004dacbfd3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964350976:0@lo:103: 00000100:00100000:1.0:1789478348.038976:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478348.039016:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789478348.039022:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7299b07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964351104:0@lo:103: 00000100:00100000:1.0:1789478348.039041:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478348.039054:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964350976 00000100:00100000:0.0:1789478348.039060:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964350976 00000100:00100000:1.0:1789478348.039072:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964351104 00000100:00100000:1.0:1789478348.039074:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964351104 00010000:00010000:0.0:1789478348.039081:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000060f398c2/0x8ebaae74e8215904 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e82158fd expref: 13 pid: 6511 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.039085:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000063a2ef82/0x8ebaae74e82158e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e82158e1 expref: 13 pid: 6510 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478348.039103:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789478348.039108:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026f05915 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+13:3647:x1876403964351104:12345-0@lo:103: 00010000:00010000:1.0:1789478348.039117:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478348.039121:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000063a2ef82/0x8ebaae74e82158e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e82158e1 expref: 13 pid: 6510 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.039129:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000063a2ef82/0x8ebaae74e82158e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e82158e1 expref: 13 pid: 6510 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.039141:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000063a2ef82/0x8ebaae74e82158e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e82158e1 expref: 13 pid: 6510 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.039163:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478348.039264:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026f05915 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+12:3647:x1876403964351104:12345-0@lo:103: Request processed in 156us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478348.039271:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789478348.039285:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789478348.039291:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001d2d5af pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+11:3647:x1876403964350976:12345-0@lo:103: 00010000:00010000:1.0:1789478348.039299:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478348.039302:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000060f398c2/0x8ebaae74e8215904 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e82158fd expref: 11 pid: 6511 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.039310:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000060f398c2/0x8ebaae74e8215904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e82158fd expref: 11 pid: 6511 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.039318:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000060f398c2/0x8ebaae74e8215904 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e82158fd expref: 11 pid: 6511 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.039327:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000002eb86c8/0x8ebaae74e82159b3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.039333:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000002eb86c8/0x8ebaae74e82159b3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.039345:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000002eb86c8/0x8ebaae74e82159b3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.039350:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000002eb86c8/0x8ebaae74e82159b3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.039356:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000002eb86c8/0x8ebaae74e82159b3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.039367:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000002eb86c8/0x8ebaae74e82159b3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.039372:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000002eb86c8 already unused, calling callback (00000000d680f8d5) 00010000:00010000:1.0:1789478348.039375:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000002eb86c8/0x8ebaae74e82159b3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.039381:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000002eb86c8/0x8ebaae74e82159b3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.039399:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000002eb86c8/0x8ebaae74e82159b3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.039407:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478348.039429:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001d2d5af pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+10:3647:x1876403964350976:12345-0@lo:103: Request processed in 139us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478348.039434:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789478348.039578:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7299b07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964351104:0@lo:103: 00000100:00100000:2.0:1789478348.039587:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004dacbfd3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964350976:0@lo:103: 00010000:00010000:3.0:1789478348.039683:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478348.040529:0:6511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000002eb86c8/0x8ebaae74e82159b3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.040540:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000002eb86c8/0x8ebaae74e82159b3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.040545:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000002eb86c8/0x8ebaae74e82159b3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789478348.040560:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789478348.047316:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000c09457 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+9:7446:x1876403964350336:12345-0@lo:253: Request processed in 53815us (54100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478348.047331:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789478348.047341:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0a93f71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964350336:0@lo:253: 10000000:01000000:2.0:1789478348.047354:0:7446:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789478348.047357:0:7446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789478348.047359:0:7446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789478348.047360:0:7446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478348.047361:0:7446:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1789478348.047362:0:7446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478348.047367:0:7446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478348.047368:0:7446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789478348.047370:0:7446:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789478348.047371:0:7446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478348.047372:0:7446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789478348.047388:0:7446:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000024a94445 from lustre-MDT0001 10000000:01000000:2.0:1789478348.047415:0:7446:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789478348.047418:0:7446:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789478348.047423:0:7446:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ebc08d93370 local copy 10000000:01000000:2.0:1789478348.047427:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789478348.047459:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e82159ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.047469:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e82159ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.047476:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e82159ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478348.047491:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0a93f71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964351232:0@lo:101: 00000100:00100000:2.0:1789478348.047521:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478348.047559:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c778d186 going to sleep for 11 seconds 00000100:00100000:3.0:1789478348.048028:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964351232 00000100:00100000:3.0:1789478348.048035:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964351232 00000100:00100000:3.0:1789478348.048100:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789478348.048109:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000339e515c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+9:7446:x1876403964351232:12345-0@lo:101: 00010000:00010000:3.0:1789478348.048120:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478348.048132:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000431872c4/0x8ebaae74e82159c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e82159ba expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.048153:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000431872c4/0x8ebaae74e82159c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e82159ba expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.048162:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000431872c4/0x8ebaae74e82159c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e82159ba expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.048170:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000431872c4, rc 0) 00000100:00100000:3.0:1789478348.048226:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000339e515c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+10:7446:x1876403964351232:12345-0@lo:101: Request processed in 118us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478348.048232:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789478348.048336:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0a93f71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964351232:0@lo:101: 00010000:00010000:2.0:1789478348.048348:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e82159ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8ebaae74e82159c1 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.048356:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e82159ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8ebaae74e82159c1 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478348.048431:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0a93f71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964351360:0@lo:501: 00000100:00100000:2.0:1789478348.048469:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478348.048499:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c778d186 going to sleep for 11 seconds 00000100:00100000:0.0:1789478348.049375:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964351360 00000100:00100000:0.0:1789478348.049384:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964351360 00000100:00100000:1.0:1789478348.049467:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789478348.049475:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b014f656 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+10:7446:x1876403964351360:12345-0@lo:501: 00000100:00100000:1.0:1789478348.049560:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b014f656 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+10:7446:x1876403964351360:12345-0@lo:501: Request processed in 86us (1091us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789478348.049566:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789478348.052070:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0a93f71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964351360:0@lo:501: 10000000:01000000:3.0:1789478348.052108:0:7446:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789478348.052149:0:7446:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789478348.052156:0:7446:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e82159ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8ebaae74e82159c1 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.052164:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e82159ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8ebaae74e82159c1 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.052193:0:7446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e82159ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8ebaae74e82159c1 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.052218:0:7446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789478348.052248:0:7446:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ebc34d64800 10000000:01000000:3.0:1789478348.052254:0:7446:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789478348.052258:0:7446:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8ebc08d93370 10000000:01000000:3.0:1789478348.052260:0:7446:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789478348.052263:0:7446:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8ebc08d93370 from 1 10000000:01000000:3.0:1789478348.052265:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789478348.052292:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 00000000fa3328be/0x8ebaae74e82159c8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.052299:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 00000000fa3328be/0x8ebaae74e82159c8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.052309:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 00000000fa3328be/0x8ebaae74e82159c8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478348.052325:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c7c524c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964351488:0@lo:101: 00000100:00100000:3.0:1789478348.052377:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478348.052436:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 0000000058657989 going to sleep for 11 seconds 00000100:00100000:0.0:1789478348.052645:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964351488 00000100:00100000:0.0:1789478348.052652:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964351488 00000100:00100000:0.0:1789478348.052703:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789478348.052711:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1b445b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+10:7446:x1876403964351488:12345-0@lo:101: 00010000:00010000:0.0:1789478348.052722:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478348.052734:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fb4c98fa/0x8ebaae74e82159cf lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e82159c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.052754:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fb4c98fa/0x8ebaae74e82159cf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e82159c8 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.052764:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fb4c98fa/0x8ebaae74e82159cf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e82159c8 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.052771:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fb4c98fa, rc 0) 00000100:00100000:0.0:1789478348.052809:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1b445b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+11:7446:x1876403964351488:12345-0@lo:101: Request processed in 100us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478348.052816:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789478348.053334:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c7c524c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964351488:0@lo:101: 00010000:00010000:3.0:1789478348.053347:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 00000000fa3328be/0x8ebaae74e82159c8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82159cf expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.053355:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 00000000fa3328be/0x8ebaae74e82159c8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e82159cf expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478348.053399:0:7446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789478348.053416:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 00000000fa3328be/0x8ebaae74e82159c8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82159cf expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.053423:0:7446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 00000000fa3328be/0x8ebaae74e82159c8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82159cf expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478348.053432:0:7446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ebc34d64800 10000000:01000000:3.0:1789478348.053435:0:7446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789478348.053439:0:7446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ebc34d64800 from 1 10000000:01000000:3.0:1789478348.053441:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789478348.053458:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 00000000ccbdabb5/0x8ebaae74e82159d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.053464:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 00000000ccbdabb5/0x8ebaae74e82159d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.053471:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 00000000ccbdabb5/0x8ebaae74e82159d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478348.053483:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c7c524c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964351616:0@lo:101: 00000100:00100000:3.0:1789478348.053516:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478348.053548:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 0000000058657989 going to sleep for 11 seconds 00000100:00100000:2.0:1789478348.053640:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964351616 00000100:00100000:2.0:1789478348.053646:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964351616 00010000:00010000:1.0:1789478348.053656:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789478348.053663:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e82159ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8ebaae74e82159c1 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.053670:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007c1ae027 already unused, calling callback (00000000ec062f3f) 10000000:00010000:1.0:1789478348.053673:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e82159ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8ebaae74e82159c1 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478348.053678:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789478348.053687:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045894c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+11:7446:x1876403964351616:12345-0@lo:101: 00010000:00010000:1.0:1789478348.053690:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e82159ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x8ebaae74e82159c1 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.053696:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 10000000:00010000:1.0:1789478348.053700:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e82159ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x8ebaae74e82159c1 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.053708:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ab989a9e/0x8ebaae74e82159dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e82159d6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478348.053708:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789478348.053727:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ab989a9e/0x8ebaae74e82159dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e82159d6 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.053732:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e82159ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8ebaae74e82159c1 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.053737:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ab989a9e/0x8ebaae74e82159dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e82159d6 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.053746:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789478348.053752:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ab989a9e, rc 0) 00010000:00010000:1.0:1789478348.053775:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e82159ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8ebaae74e82159c1 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.053783:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e82159ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8ebaae74e82159c1 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478348.053786:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045894c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+12:7446:x1876403964351616:12345-0@lo:101: Request processed in 100us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478348.053800:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1789478348.053810:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478348.053813:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478348.053815:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478348.053829:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789478348.053839:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004353e414 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964351744:0@lo:103: 00000100:00100000:2.0:1789478348.053866:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478348.053879:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c7c524c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964351616:0@lo:101: 00010000:00010000:3.0:1789478348.053892:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 00000000ccbdabb5/0x8ebaae74e82159d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82159dd expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.053899:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 00000000ccbdabb5/0x8ebaae74e82159d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e82159dd expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478348.053917:0:7446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789478348.053933:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 00000000ccbdabb5/0x8ebaae74e82159d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82159dd expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.053939:0:7446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 00000000ccbdabb5/0x8ebaae74e82159d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82159dd expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478348.053945:0:7446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789478348.053948:0:7446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789478348.053953:0:7446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ebc34d64800 10000000:01000000:3.0:1789478348.053956:0:7446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789478348.053960:0:7446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1789478348.053962:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789478348.053975:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 000000001c69e0ba/0x8ebaae74e82159e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.053981:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 000000001c69e0ba/0x8ebaae74e82159e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.053987:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 000000001c69e0ba/0x8ebaae74e82159e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478348.053998:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c7c524c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964351872:0@lo:101: 00000100:00100000:3.0:1789478348.054022:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478348.054055:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 0000000058657989 going to sleep for 11 seconds 00000100:00100000:2.0:1789478348.054172:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964351872 00000100:00100000:2.0:1789478348.054187:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964351872 00000100:00100000:2.0:1789478348.054221:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789478348.054227:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008bb7084c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+12:7446:x1876403964351872:12345-0@lo:101: 00010000:00010000:2.0:1789478348.054234:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478348.054242:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000002eb86c8/0x8ebaae74e82159eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e82159e4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.054267:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000002eb86c8/0x8ebaae74e82159eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e82159e4 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.054274:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000002eb86c8/0x8ebaae74e82159eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e82159e4 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.054281:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000002eb86c8, rc 0) 00000100:00100000:2.0:1789478348.054319:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008bb7084c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+13:7446:x1876403964351872:12345-0@lo:101: Request processed in 93us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478348.054325:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789478348.054399:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c7c524c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964351872:0@lo:101: 00010000:00010000:0.0:1789478348.054409:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 000000001c69e0ba/0x8ebaae74e82159e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82159eb expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.054416:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 000000001c69e0ba/0x8ebaae74e82159e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e82159eb expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478348.054496:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005fb3cf93 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964352000:0@lo:501: 00000100:00100000:0.0:1789478348.054521:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478348.054552:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 0000000003098741 going to sleep for 11 seconds 00000100:00100000:1.0:1789478348.054581:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964351744 00000100:00100000:3.0:1789478348.054623:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964352000 00000100:00100000:3.0:1789478348.054629:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964352000 00000100:00100000:1.0:1789478348.054633:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964351744 00000100:00100000:3.0:1789478348.054656:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789478348.054664:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038641d62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+14:7446:x1876403964352000:12345-0@lo:501: 00000100:00100000:1.0:1789478348.054673:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789478348.054682:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018e97395 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+14:3646:x1876403964351744:12345-0@lo:103: 00010000:00010000:1.0:1789478348.054692:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478348.054701:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000431872c4/0x8ebaae74e82159c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ebaae74e82159ba expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.054712:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478348.054749:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018e97395 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+13:3646:x1876403964351744:12345-0@lo:103: Request processed in 68us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478348.054756:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789478348.054776:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038641d62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+12:7446:x1876403964352000:12345-0@lo:501: Request processed in 113us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478348.054784:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789478348.054846:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005fb3cf93 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964352000:0@lo:501: 00000100:00100000:0.0:1789478348.054874:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005fb3cf93 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964352128:0@lo:503: 00000100:00100000:2.0:1789478348.054882:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004353e414 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964351744:0@lo:103: 00000100:00100000:0.0:1789478348.054914:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478348.054952:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 0000000003098741 going to sleep for 11 seconds 00000100:00100000:3.0:1789478348.055043:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964352128 00000100:00100000:3.0:1789478348.055047:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964352128 00000100:00100000:3.0:1789478348.055075:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789478348.055242:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c348ef91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+12:7446:x1876403964352128:12345-0@lo:503: 00000100:00100000:3.0:1789478348.055322:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c348ef91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+12:7446:x1876403964352128:12345-0@lo:503: Request processed in 242us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478348.055328:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789478348.055436:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005fb3cf93 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964352128:0@lo:503: 00000040:00080000:0.0:1789478348.055671:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789478348.055732:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005fb3cf93 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964352256:0@lo:502: 00000100:00100000:0.0:1789478348.055763:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478348.055785:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 0000000003098741 going to sleep for 11 seconds 00000100:00100000:2.0:1789478348.056199:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964352256 00000100:00100000:2.0:1789478348.056204:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964352256 00000100:00100000:2.0:1789478348.056244:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789478348.056251:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006bdfe411 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+12:7446:x1876403964352256:12345-0@lo:502: 00000100:00100000:2.0:1789478348.056349:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006bdfe411 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+12:7446:x1876403964352256:12345-0@lo:502: Request processed in 99us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478348.056356:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789478348.056522:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005fb3cf93 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964352256:0@lo:502: 00000040:00080000:3.0:1789478348.056769:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789478348.056798:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1789478348.056813:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1789478348.056827:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1789478348.056841:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1789478348.056857:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1789478348.056872:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1789478348.056887:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1789478348.056900:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1789478348.056913:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1789478348.056927:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1789478348.056941:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1789478348.056955:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1789478348.056971:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1789478348.056984:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1789478348.056999:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1789478348.057012:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1789478348.057048:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1789478348.057074:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1789478348.058318:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1789478348.058343:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1789478348.058358:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1789478348.058371:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1789478348.058408:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a49f04f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964352384:0@lo:502: 00000100:00100000:3.0:1789478348.058477:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478348.058523:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 0000000045f06a16 going to sleep for 11 seconds 00000100:00100000:2.0:1789478348.058680:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964352384 00000100:00100000:2.0:1789478348.058687:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964352384 00000100:00100000:2.0:1789478348.058723:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789478348.058731:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab29fecb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+12:7446:x1876403964352384:12345-0@lo:502: 00000100:00100000:2.0:1789478348.058831:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab29fecb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+12:7446:x1876403964352384:12345-0@lo:502: Request processed in 101us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478348.058839:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789478348.059191:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a49f04f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964352384:0@lo:502: 00000040:00080000:3.0:1789478348.059236:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1789478348.059244:0:7446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1789478348.060039:0:7458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789478348.060049:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478348.060051:0:7458:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789478348.060056:0:7458:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1789478348.060059:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789478348.060071:0:7458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000051bf4054) 00000020:00000080:0.0:1789478348.060089:0:7458:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1789478348.060094:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789478348.060166:0:7458:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789478348.060195:0:7458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8ebaae74e82159f9 00000020:00000080:0.0:1789478348.060409:0:7458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789478348.060413:0:7458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789478348.060416:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478348.060418:0:7458:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789478348.060420:0:7458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789478348.060424:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478348.060425:0:7458:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1789478348.060428:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789478348.060434:0:7458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000fcb829d2) 00000020:00000080:0.0:1789478348.060445:0:7458:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1789478348.060454:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789478348.060456:0:7458:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1789478348.060459:0:7458:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1789478348.060465:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789478348.060509:0:7458:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000024a94445 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1789478348.060529:0:7458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000905cbf40) 00000020:00000080:0.0:1789478348.060539:0:7458:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1789478348.060633:0:7458:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789478348.060638:0:7458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8ebaae74e8215a0e 00000020:00000080:0.0:1789478348.060722:0:7458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1789478348.060728:0:7458:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789478348.060732:0:7458:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x8ebaae74e8215a15 00080000:01000000:0.0:1789478348.060737:0:7458:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789478348.060740:0:7458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8ebaae74e8215a1c 00080000:10000000:0.0:1789478348.061078:0:7458:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1789478348.061215:0:7458:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1789478348.148121:0:7458:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1789478348.150225:0:7458:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1789478348.154873:0:7458:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789478348.155301:0:7458:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 10000000:01000000:2.0:1789478348.156915:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789478348.156920:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ebc0501d800 from 21 10000000:01000000:2.0:1789478348.156925:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789478348.156960:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 0000000063a2ef82/0x8ebaae74e8215a23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.156972:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 0000000063a2ef82/0x8ebaae74e8215a23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.156982:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 0000000063a2ef82/0x8ebaae74e8215a23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478348.157003:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073a2fa4c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964352512:0@lo:101: 00000100:00100000:2.0:1789478348.157080:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478348.157144:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 000000001e64aa54 going to sleep for 11 seconds 00000100:00100000:0.0:1789478348.158355:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964352512 00000100:00100000:0.0:1789478348.158368:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964352512 00000100:00100000:0.0:1789478348.158428:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789478348.158437:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000981385a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+12:6514:x1876403964352512:12345-0@lo:101: 00010000:00010000:0.0:1789478348.158473:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478348.158488:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000060f398c2/0x8ebaae74e8215a2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215a23 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.158513:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000060f398c2/0x8ebaae74e8215a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215a23 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.158523:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000060f398c2/0x8ebaae74e8215a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215a23 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.158533:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000060f398c2, rc 0) 00000100:00100000:0.0:1789478348.158634:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000981385a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+13:6514:x1876403964352512:12345-0@lo:101: Request processed in 198us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478348.158641:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789478348.158936:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073a2fa4c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964352512:0@lo:101: 00010000:00010000:3.0:1789478348.158952:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 0000000063a2ef82/0x8ebaae74e8215a23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215a2a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.158960:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 0000000063a2ef82/0x8ebaae74e8215a23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215a2a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478348.159038:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a49f04f3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964352640:0@lo:501: 00000100:00100000:3.0:1789478348.159097:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478348.159182:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 0000000045f06a16 going to sleep for 11 seconds 00000100:00100000:0.0:1789478348.159259:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964352640 00000100:00100000:0.0:1789478348.159264:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964352640 00000100:00100000:2.0:1789478348.161983:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789478348.161999:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003973446f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+13:6514:x1876403964352640:12345-0@lo:501: 00000100:00100000:2.0:1789478348.162379:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003973446f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+13:6514:x1876403964352640:12345-0@lo:501: Request processed in 385us (3282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478348.162388:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789478348.164217:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a49f04f3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964352640:0@lo:501: 00000100:00100000:0.0:1789478348.164276:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006ce928a7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964352768:0@lo:503: 00000100:00100000:0.0:1789478348.164346:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478348.164437:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 000000004ded709b going to sleep for 11 seconds 00000100:00100000:2.0:1789478348.164503:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964352768 00000100:00100000:2.0:1789478348.164510:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964352768 00000100:00100000:0.0:1789478348.165200:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789478348.165212:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a8f666e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+13:6514:x1876403964352768:12345-0@lo:503: 00000100:00100000:0.0:1789478348.165338:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a8f666e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+13:6514:x1876403964352768:12345-0@lo:503: Request processed in 130us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478348.165346:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789478348.165506:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006ce928a7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964352768:0@lo:503: 00000100:00100000:2.0:1789478348.167323:0:7459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b1ca62a0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:7459:1876403964352896:0@lo:502: 00000100:00100000:2.0:1789478348.167393:0:7459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478348.167428:0:7459:0:(client.c:2715:ptlrpc_set_wait()) set 000000001d68b99e going to sleep for 11 seconds 00000100:00100000:0.0:1789478348.167482:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964352896 00000100:00100000:0.0:1789478348.167488:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964352896 00000100:00100000:0.0:1789478348.167567:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789478348.167575:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059b3eeed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+13:7459:x1876403964352896:12345-0@lo:502: 00000100:00100000:0.0:1789478348.167728:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059b3eeed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+13:7459:x1876403964352896:12345-0@lo:502: Request processed in 153us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478348.167736:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000020:00000080:1.0:1789478348.167799:0:7458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789478348.167807:0:7458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789478348.167813:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478348.167815:0:7458:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789478348.167818:0:7458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789478348.167823:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478348.167824:0:7458:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789478348.167827:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789478348.167831:0:7458:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:00000080:1.0:1789478348.167853:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789478348.167865:0:7458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000822a66a2) 00000020:00000080:1.0:1789478348.168482:0:7458:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1789478348.168493:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789478348.168562:0:7458:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789478348.168568:0:7458:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789478348.168576:0:7458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8ebaae74e8215a38 00010000:00080000:1.0:1789478348.168620:0:7458:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000529eeb94@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.111@tcp at head 00000100:00100000:2.0:1789478348.170412:0:7459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b1ca62a0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:7459:1876403964352896:0@lo:502: 00000100:00100000:2.0:1789478348.170501:0:7459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b1ca62a0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:7459:1876403964353024:0@lo:502: 00000100:00100000:2.0:1789478348.170564:0:7459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478348.171432:0:7459:0:(client.c:2715:ptlrpc_set_wait()) set 000000001d68b99e going to sleep for 11 seconds 00000100:00100000:2.0:1789478348.171795:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964353024 00000100:00100000:2.0:1789478348.171802:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964353024 00000100:00100000:2.0:1789478348.171844:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789478348.171853:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cff8869d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+13:7459:x1876403964353024:12345-0@lo:502: 00010000:00010000:1.0:1789478348.173548:0:7458:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000100:00100000:0.0:1789478348.176191:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cff8869d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+13:7459:x1876403964353024:12345-0@lo:502: Request processed in 4324us (5611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478348.176205:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789478348.176385:0:7459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b1ca62a0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:7459:1876403964353024:0@lo:502: 00000040:00080000:2.0:1789478348.176420:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789478348.177226:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789478348.177251:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789478348.177259:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 0000000063a2ef82/0x8ebaae74e8215a23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215a2a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.177280:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 0000000063a2ef82/0x8ebaae74e8215a23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215a2a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478348.177289:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789478348.177292:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789478348.177295:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789478348.177323:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 0000000072891110/0x8ebaae74e8215a3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.177330:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 0000000072891110/0x8ebaae74e8215a3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.177339:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 0000000072891110/0x8ebaae74e8215a3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478348.177357:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000563eded3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964353152:0@lo:101: 00000100:00100000:0.0:1789478348.177406:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478348.177456:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 000000004100a7a1 going to sleep for 11 seconds 00000100:00100000:1.0:1789478348.177922:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964353152 00000100:00100000:1.0:1789478348.177929:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964353152 00000100:00100000:1.0:1789478348.177979:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789478348.177988:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043700670 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+13:6514:x1876403964353152:12345-0@lo:101: 00010000:00010000:1.0:1789478348.178000:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478348.178012:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003b14c9e2/0x8ebaae74e8215a46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215a3f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.178031:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003b14c9e2/0x8ebaae74e8215a46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215a3f expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.178125:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003b14c9e2/0x8ebaae74e8215a46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215a3f expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.178133:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003b14c9e2, rc 0) 00000100:00100000:1.0:1789478348.178250:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043700670 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+14:6514:x1876403964353152:12345-0@lo:101: Request processed in 263us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478348.178257:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000020:00000080:0.0:1789478348.179364:0:7458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789478348.179377:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789478348.179418:0:7458:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789478348.179438:0:7458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8ebaae74e8215a4d 00000100:00080000:0.0:1789478348.179447:0:7458:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789478348.179455:0:7458:0:(import.c:625:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000529eeb94 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1789478348.179484:0:7458:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000023650e0f x1876403964353280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789478348.179573:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000563eded3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964353152:0@lo:101: 00010000:00010000:2.0:1789478348.179589:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 0000000072891110/0x8ebaae74e8215a3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215a46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.179611:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 0000000072891110/0x8ebaae74e8215a3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215a46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478348.179845:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b1ca62a0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964353408:0@lo:501: 00000100:00100000:2.0:1789478348.179893:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478348.179925:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 000000001d68b99e going to sleep for 11 seconds 00000100:00080000:0.0:1789478348.180106:0:7458:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789478348.180430:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000023650e0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964353280:0@lo:38: 00000020:01000000:0.0:1789478348.180439:0:7458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789478348.180452:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478348.180454:0:7458:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1789478348.180458:0:7458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789478348.180461:0:7458:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789478348.180463:0:7458:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789478348.180465:0:7458:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789478348.180466:0:7458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789478348.180470:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478348.180473:0:7458:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000100:00100000:1.0:1789478348.180476:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1789478348.180479:0:7458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789478348.180485:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478348.180487:0:7458:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1789478348.180491:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789478348.180523:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964353408 00000004:01000000:0.0:1789478348.180528:0:7458:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1789478348.180530:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964353408 00000020:01000000:0.0:1789478348.180546:0:7458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789478348.180551:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478348.180552:0:7458:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1789478348.180555:0:7458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789478348.180557:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478348.180558:0:7458:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789478348.180561:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789478348.180563:0:7458:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789478348.180570:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789478348.180579:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cf43f74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+14:6514:x1876403964353408:12345-0@lo:501: 00000020:01000000:0.0:1789478348.180590:0:7458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789478348.180614:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478348.180615:0:7458:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789478348.180630:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:1.0:1789478348.180715:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cf43f74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+14:6514:x1876403964353408:12345-0@lo:501: Request processed in 138us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478348.180723:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789478348.180788:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964353280 00000100:00100000:0.0:1789478348.180793:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964353280 00000100:00100000:1.0:1789478348.180844:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b1ca62a0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964353408:0@lo:501: 00000100:00100000:1.0:1789478348.180884:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000013061189 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964353536:0@lo:503: 00000100:00100000:1.0:1789478348.180929:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478348.180942:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b8b95ac going to sleep for 11 seconds 00000100:00100000:1.0:1789478348.180958:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964353536 00000100:00100000:1.0:1789478348.180961:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964353536 00000100:00100000:1.0:1789478348.180981:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789478348.180986:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005303aa8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+14:6514:x1876403964353536:12345-0@lo:503: 00000100:00100000:1.0:1789478348.181060:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005303aa8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+14:6514:x1876403964353536:12345-0@lo:503: Request processed in 74us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478348.181071:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789478348.181115:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000013061189 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964353536:0@lo:503: 00000100:00100000:0.0:1789478348.181337:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789478348.181342:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009dc3e9ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876403964353280:12345-0@lo:38: 00010000:00080000:0.0:1789478348.181361:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:0.0:1789478348.181399:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8ebaae74e8215a54 00000004:00100000:0.0:1789478348.181413:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789478348.181422:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:0.0:1789478348.181514:0:7446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1789478348.181536:0:7446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789478348.181543:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 000000001c69e0ba/0x8ebaae74e82159e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82159eb expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.181552:0:7446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 000000001c69e0ba/0x8ebaae74e82159e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82159eb expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478348.181559:0:7446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ebc34d64800 from 1 10000000:01000000:0.0:1789478348.181561:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789478348.181581:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 00000000ab5ee7e5/0x8ebaae74e8215a5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.181588:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 00000000ab5ee7e5/0x8ebaae74e8215a5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478348.181782:0:7464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000013061189 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:7464:1876403964353792:0@lo:502: 00000100:00100000:1.0:1789478348.181823:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478348.181855:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964353792 00000100:00100000:1.0:1789478348.181859:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964353792 00010000:00010000:0.0:1789478348.181878:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 00000000ab5ee7e5/0x8ebaae74e8215a5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478348.181891:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b1f04b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964353664:0@lo:101: 00000100:00100000:0.0:1789478348.181919:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478348.181943:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079e40c4e going to sleep for 11 seconds 00000100:00100000:0.0:1789478348.181962:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bfee153d going to sleep for 11 seconds 00000100:00100000:1.0:1789478348.182029:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964353664 00000100:00100000:1.0:1789478348.182033:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964353664 00000100:00100000:1.0:1789478348.182046:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789478348.182052:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039acf773 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+15:7464:x1876403964353792:12345-0@lo:502: 00000100:00100000:0.0:1789478348.182097:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789478348.182107:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a26dae9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+15:7446:x1876403964353664:12345-0@lo:101: 00010000:00010000:0.0:1789478348.182116:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478348.182128:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000c4b9469/0x8ebaae74e8215a62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215a5b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.182158:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000c4b9469/0x8ebaae74e8215a62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215a5b expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.182167:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000c4b9469/0x8ebaae74e8215a62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215a5b expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.182184:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000c4b9469, rc 0) 00000100:00100000:0.0:1789478348.182214:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a26dae9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+16:7446:x1876403964353664:12345-0@lo:101: Request processed in 111us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478348.182221:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789478348.182257:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b1f04b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964353664:0@lo:101: 00010000:00010000:0.0:1789478348.182268:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 00000000ab5ee7e5/0x8ebaae74e8215a5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215a62 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.182275:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 00000000ab5ee7e5/0x8ebaae74e8215a5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215a62 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478348.182341:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039acf773 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+15:7464:x1876403964353792:12345-0@lo:502: Request processed in 289us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478348.182419:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789478348.182464:0:7464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000013061189 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:7464:1876403964353792:0@lo:502: 00000020:01000000:1.0:1789478348.182485:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789478348.182493:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478348.182495:0:7464:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1789478348.182500:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789478348.182503:0:7464:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:00000080:1.0:1789478348.182588:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789478348.182624:0:7464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (0000000066020657) 00000020:00000080:1.0:1789478348.182640:0:7464:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osp with refcount 2 00000020:00000080:1.0:1789478348.182644:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789478348.182731:0:7464:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1789478348.182736:0:7464:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789478348.182743:0:7464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ebaae74e8215a70 00010000:00080000:1.0:1789478348.182778:0:7464:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000590e9c98@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.111@tcp at head 00000100:00100000:2.0:1789478348.183484:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dc08741d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876403964353920:0@lo:400: 00000100:00100000:2.0:1789478348.183529:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478348.183569:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964353920 00000100:00100000:2.0:1789478348.183575:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964353920 00000100:00100000:2.0:1789478348.183962:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789478348.183971:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000221c77e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876403964353920:12345-0@lo:400: 00000100:00100000:0.0:1789478348.184581:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b1f04b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964354048:0@lo:256: 00000100:00100000:0.0:1789478348.185112:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478348.185129:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000221c77e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876403964353920:12345-0@lo:400: Request processed in 1157us (1597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478348.185147:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789478348.185154:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079e40c4e going to sleep for 11 seconds 00000100:00100000:0.0:1789478348.185198:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964354048 00000100:00100000:0.0:1789478348.185205:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964354048 00010000:00080000:2.0:1789478348.185217:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000dc08741d x1876403964353920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478348.185232:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dc08741d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876403964353920:0@lo:400: 00000100:00100000:0.0:1789478348.185252:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789478348.185261:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e481e5a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+15:7446:x1876403964354048:12345-0@lo:256: 20000000:01000000:0.0:1789478348.185276:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789478348.185294:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789478348.185298:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789478348.185395:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e481e5a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+15:7446:x1876403964354048:12345-0@lo:256: Request processed in 135us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478348.185403:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789478348.185412:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b1f04b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964354048:0@lo:256: 10000000:01000000:2.0:1789478348.186448:0:7446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789478348.186458:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 00000000ab5ee7e5/0x8ebaae74e8215a5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215a62 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.186469:0:7446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 00000000ab5ee7e5/0x8ebaae74e8215a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215a62 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478348.186476:0:7446:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebc34d64800 from 1 10000000:01000000:2.0:1789478348.186479:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789478348.186507:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e8215a77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.186515:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e8215a77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.186525:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e8215a77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478348.186540:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dc08741d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964354176:0@lo:101: 00000100:00100000:2.0:1789478348.186580:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478348.186631:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fdb7fcd9 going to sleep for 11 seconds 00000100:00100000:0.0:1789478348.187721:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964354176 00000100:00100000:0.0:1789478348.187732:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964354176 00000100:00100000:0.0:1789478348.187779:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789478348.187786:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e71aaa23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+15:7446:x1876403964354176:12345-0@lo:101: 00010000:00010000:0.0:1789478348.187815:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478348.188078:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ce317a75/0x8ebaae74e8215a7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215a77 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.188103:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ce317a75/0x8ebaae74e8215a7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215a77 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.188115:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ce317a75/0x8ebaae74e8215a7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215a77 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.188122:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ce317a75, rc 0) 00010000:00010000:1.0:1789478348.188290:0:7464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-3 is initialized 00000100:00100000:0.0:1789478348.188667:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e71aaa23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:7446:x1876403964354176:12345-0@lo:101: Request processed in 879us (2085us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478348.188675:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789478348.188990:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dc08741d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964354176:0@lo:101: 00010000:00010000:2.0:1789478348.189013:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e8215a77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215a7e expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.189022:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e8215a77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215a7e expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478348.189202:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000013061189 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964354304:0@lo:501: 00000100:00100000:1.0:1789478348.189242:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478348.189287:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 0000000013439b19 going to sleep for 11 seconds 00000100:00100000:3.0:1789478348.190729:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964354304 00000100:00100000:3.0:1789478348.190739:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964354304 00000100:00100000:3.0:1789478348.190810:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789478348.190820:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf7d1dd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:7446:x1876403964354304:12345-0@lo:501: 00000100:00100000:3.0:1789478348.190964:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf7d1dd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:7446:x1876403964354304:12345-0@lo:501: Request processed in 145us (1721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478348.190994:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789478348.191279:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000013061189 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964354304:0@lo:501: 00000100:00100000:0.0:1789478348.191319:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8199b84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964354432:0@lo:503: 00000100:00100000:0.0:1789478348.191362:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478348.191397:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 0000000040b8dede going to sleep for 11 seconds 00000100:00100000:2.0:1789478348.191484:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964354432 00000100:00100000:2.0:1789478348.191489:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964354432 00000100:00100000:2.0:1789478348.191524:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789478348.191532:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009b862c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:7446:x1876403964354432:12345-0@lo:503: 00000040:00080000:2.0:1789478348.191570:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789478348.191643:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009b862c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:7446:x1876403964354432:12345-0@lo:503: Request processed in 112us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478348.191650:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789478348.191816:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8199b84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964354432:0@lo:503: 00000040:00080000:1.0:1789478348.192047:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789478348.192109:0:7446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1789478348.192192:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789478348.193102:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1789478348.193150:0:7446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789478348.193182:0:7446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789478348.193191:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e8215a77 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215a7e expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.193202:0:7446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e8215a77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215a7e expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478348.193248:0:7446:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789478348.193251:0:7446:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ebc34d64800 10000000:01000000:1.0:1789478348.193255:0:7446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ebc34d64800 10000000:01000000:1.0:1789478348.193258:0:7446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789478348.193263:0:7446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ebc34d64800 from 1 10000000:01000000:1.0:1789478348.193265:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789478348.193291:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 0000000042e865bd/0x8ebaae74e8215a85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.193298:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 0000000042e865bd/0x8ebaae74e8215a85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.193307:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 0000000042e865bd/0x8ebaae74e8215a85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478348.193334:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ab95c05 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964354560:0@lo:101: 00000100:00100000:1.0:1789478348.193380:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789478348.193658:0:6522:0:(import.c:65:import_set_state_nolock()) 0000000066c21501 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789478348.193728:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009dc3e9ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1876403964353280:12345-0@lo:38: Request processed in 12384us (13254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478348.193741:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789478348.193785:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789478348.193793:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789478348.193799:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789478348.193803:0:3644:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789478348.193805:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000529eeb94 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789478348.193817:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000023650e0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964353280:0@lo:38: 00000100:00100000:2.0:1789478348.193864:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dc08741d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964354688:0@lo:41: 00000100:00100000:2.0:1789478348.193889:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478348.193934:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964354688 00000100:00100000:2.0:1789478348.193945:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964354688 00000100:00100000:2.0:1789478348.193975:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789478348.193983:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ddf1c79f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1876403964354688:12345-0@lo:41: 00000004:00000024:2.0:1789478348.194006:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1789478348.194041:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ddf1c79f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1876403964354688:12345-0@lo:41: Request processed in 59us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478348.194046:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789478348.194081:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dc08741d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964354688:0@lo:41: 00000100:00100000:1.0:1789478348.194214:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 000000002589d4b5 going to sleep for 11 seconds 00000020:00000080:3.0:1789478348.194887:0:7464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789478348.194909:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789478348.194958:0:7464:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789478348.194986:0:7464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8ebaae74e8215a8c 00000100:00080000:3.0:1789478348.195000:0:7464:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789478348.195013:0:7464:0:(import.c:625:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000590e9c98 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1789478348.195063:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964354560 00000100:00100000:3.0:1789478348.195067:0:7464:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006036912f x1876403964354816/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789478348.195072:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964354560 00000100:00100000:0.0:1789478348.195134:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789478348.195142:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007825cd14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:7446:x1876403964354560:12345-0@lo:101: 00010000:00010000:0.0:1789478348.195161:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478348.195183:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cafe8bdf/0x8ebaae74e8215a93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215a85 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.195205:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cafe8bdf/0x8ebaae74e8215a93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215a85 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.195215:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cafe8bdf/0x8ebaae74e8215a93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215a85 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.195223:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cafe8bdf, rc 0) 00000100:00100000:0.0:1789478348.195266:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007825cd14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+17:7446:x1876403964354560:12345-0@lo:101: Request processed in 125us (1886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478348.195272:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789478348.195338:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006036912f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964354816:0@lo:38: 00000100:00100000:1.0:1789478348.195373:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789478348.195379:0:7464:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789478348.195450:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ab95c05 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964354560:0@lo:101: 00010000:00010000:1.0:1789478348.195464:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 0000000042e865bd/0x8ebaae74e8215a85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215a93 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478348.195478:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 0000000042e865bd/0x8ebaae74e8215a85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215a93 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478348.195573:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ab95c05 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964354944:0@lo:501: 00000100:00100000:1.0:1789478348.195621:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478348.195648:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 000000002589d4b5 going to sleep for 11 seconds 00000100:00100000:1.0:1789478348.195663:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964354944 00000100:00100000:1.0:1789478348.195666:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964354944 00000100:00100000:0.0:1789478348.195774:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964354816 00000100:00100000:0.0:1789478348.195778:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964354816 00000100:00100000:0.0:1789478348.195803:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789478348.195808:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f79089cf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876403964354816:12345-0@lo:38: 00000100:00100000:0.0:1789478348.195859:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f79089cf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876403964354816:12345-0@lo:38: Request processed in 48us (483us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789478348.195865:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:01000000:3.0:1789478348.195873:0:7464:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1789478348.196042:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789478348.196052:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7db170a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+17:7446:x1876403964354944:12345-0@lo:501: 00000100:00100000:1.0:1789478348.196219:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7db170a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+17:7446:x1876403964354944:12345-0@lo:501: Request processed in 170us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478348.196225:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789478348.196258:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789478348.196264:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000590e9c98 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789478348.196267:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789478348.196278:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006036912f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964354816:0@lo:38: 00000100:00100000:0.0:1789478348.196470:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ab95c05 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964354944:0@lo:501: 00000100:00100000:0.0:1789478348.196499:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ac02b4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964355072:0@lo:503: 00000100:00100000:0.0:1789478348.196537:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789478348.196805:0:7468:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@0000000031a53516 x1876403964355200/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478348.196820:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 0000000058657989 going to sleep for 0 seconds 00000020:01000000:2.0:1789478348.196853:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789478348.196861:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478348.196862:0:7464:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1789478348.196866:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789478348.196869:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478348.196871:0:7464:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789478348.196874:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789478348.196875:0:7464:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789478348.196897:0:7464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dc08741d pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:7464:1876403964355328:0@lo:502: 00000100:00100000:2.0:1789478348.196936:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478348.197040:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d9406f2 going to sleep for 11 seconds 00000100:00100000:2.0:1789478348.197182:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e475c9a going to sleep for 11 seconds 00000100:00100000:1.0:1789478348.197210:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964355072 00000100:00100000:1.0:1789478348.197215:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964355072 00000100:00100000:0.0:1789478348.197257:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964355328 00000100:00100000:0.0:1789478348.197261:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964355328 00000100:00100000:0.0:1789478348.197290:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789478348.197304:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001293e4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+18:7446:x1876403964355072:12345-0@lo:503: 00000100:00100000:0.0:1789478348.197399:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001293e4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+18:7446:x1876403964355072:12345-0@lo:503: Request processed in 95us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478348.197406:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789478348.197446:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789478348.197452:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d7298e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+17:7464:x1876403964355328:12345-0@lo:502: 00000100:00100000:0.0:1789478348.197520:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d7298e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+17:7464:x1876403964355328:12345-0@lo:502: Request processed in 68us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478348.197526:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789478348.197661:0:7464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dc08741d pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:7464:1876403964355328:0@lo:502: 00000020:01000000:2.0:1789478348.197693:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789478348.197697:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478348.197699:0:7464:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789478348.197702:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1789478348.198038:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1789478348.198059:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789478348.198066:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 0000000072891110/0x8ebaae74e8215a3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215a46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.198075:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 0000000072891110/0x8ebaae74e8215a3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215a46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478348.198084:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789478348.198086:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ebc08d93370 from 1 10000000:01000000:0.0:1789478348.198088:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789478348.198109:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 0000000029fb7321/0x8ebaae74e8215a9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.198116:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 0000000029fb7321/0x8ebaae74e8215a9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.198123:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 0000000029fb7321/0x8ebaae74e8215a9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478348.198145:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8be1764 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964355456:0@lo:101: 00000100:00100000:0.0:1789478348.198183:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478348.198207:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000102b6dd8 going to sleep for 11 seconds 00000100:00100000:0.0:1789478348.198220:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964355456 00000100:00100000:0.0:1789478348.198223:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964355456 00000100:00100000:0.0:1789478348.198258:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789478348.198264:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c22470b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+17:6514:x1876403964355456:12345-0@lo:101: 00010000:00010000:0.0:1789478348.198271:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478348.198281:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c5b3b73a/0x8ebaae74e8215aa1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215a9a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.198298:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c5b3b73a/0x8ebaae74e8215aa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215a9a expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.198307:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c5b3b73a/0x8ebaae74e8215aa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215a9a expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.198314:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c5b3b73a, rc 0) 00000100:00100000:0.0:1789478348.198342:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c22470b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964355456:12345-0@lo:101: Request processed in 79us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478348.198347:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789478348.198375:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8be1764 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964355456:0@lo:101: 00010000:00010000:0.0:1789478348.198385:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 0000000029fb7321/0x8ebaae74e8215a9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215aa1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.198392:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 0000000029fb7321/0x8ebaae74e8215a9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215aa1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478348.198444:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8be1764 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964355584:0@lo:501: 00000100:00100000:0.0:1789478348.198467:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478348.198480:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000102b6dd8 going to sleep for 11 seconds 00000100:00100000:0.0:1789478348.198490:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964355584 00000100:00100000:0.0:1789478348.198493:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964355584 00000100:00100000:0.0:1789478348.198509:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789478348.198514:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a56048c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964355584:12345-0@lo:501: 00000100:00100000:0.0:1789478348.198583:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a56048c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964355584:12345-0@lo:501: Request processed in 69us (115us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789478348.198590:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789478348.198654:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8be1764 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964355584:0@lo:501: 10000000:01000000:0.0:1789478348.198673:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789478348.198890:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 0000000029fb7321/0x8ebaae74e8215a9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215aa1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.198898:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 0000000029fb7321/0x8ebaae74e8215a9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215aa1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478348.199015:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ac02b4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964355072:0@lo:503: 00000040:00080000:3.0:1789478348.199284:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789478348.199345:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000909346d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964355712:0@lo:502: 00000100:00100000:3.0:1789478348.199386:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478348.199408:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 0000000084aa7e3a going to sleep for 11 seconds 00000100:00100000:0.0:1789478348.199464:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964355712 00000100:00100000:0.0:1789478348.199469:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964355712 00000100:00100000:0.0:1789478348.199503:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789478348.199509:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1345600 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+18:7446:x1876403964355712:12345-0@lo:502: 00000100:00100000:0.0:1789478348.199834:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1345600 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+18:7446:x1876403964355712:12345-0@lo:502: Request processed in 325us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478348.199841:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789478348.199969:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000909346d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964355712:0@lo:502: 00000040:00080000:3.0:1789478348.200123:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789478348.200147:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789478348.200172:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789478348.200202:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789478348.200216:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789478348.200228:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789478348.200250:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789478348.200264:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789478348.200277:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789478348.200290:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789478348.200302:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789478348.200314:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789478348.200328:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789478348.200341:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789478348.200354:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789478348.200367:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789478348.200379:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789478348.200391:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789478348.200417:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789478348.200431:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789478348.200444:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789478348.200455:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789478348.200468:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789478348.200480:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789478348.200491:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789478348.200503:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1789478348.200514:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1789478348.200525:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1789478348.200559:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000909346d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964355840:0@lo:502: 00000100:00100000:3.0:1789478348.200626:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478348.200659:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 0000000084aa7e3a going to sleep for 11 seconds 00000100:00100000:2.0:1789478348.200835:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964355840 00000100:00100000:2.0:1789478348.200841:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964355840 00000100:00100000:2.0:1789478348.200875:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789478348.200882:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c0adcd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+18:7446:x1876403964355840:12345-0@lo:502: 00000100:00100000:2.0:1789478348.200973:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c0adcd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+18:7446:x1876403964355840:12345-0@lo:502: Request processed in 91us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478348.200985:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789478348.201056:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000909346d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964355840:0@lo:502: 00000040:00080000:0.0:1789478348.201097:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789478348.201105:0:7446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789478348.202039:0:7469:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789478348.202053:0:7469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000f1ab06c8) 00000020:00000080:0.0:1789478348.202071:0:7469:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type lwp with refcount 2 00000020:01000004:0.0:1789478348.202139:0:7469:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000024a94445 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789478348.202143:0:7469:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000024a94445 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789478348.202145:0:7469:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000024a94445 3 00010000:00080000:0.0:1789478348.202195:0:7469:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000066a59d89@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.111@tcp at head 00010000:00010000:1.0:1789478348.205044:0:7469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-4 is initialized 00000020:00000080:1.0:1789478348.205243:0:7469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1789478348.205284:0:7469:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789478348.205296:0:7469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x8ebaae74e8215aaf 00000100:00080000:1.0:1789478348.205306:0:7469:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789478348.205315:0:7469:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000066a59d89 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1789478348.205350:0:7469:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002ab9669b x1876403964355968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789478348.205414:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ab9669b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876403964355968:0@lo:38: 00000100:00100000:2.0:1789478348.205477:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789478348.205532:0:7469:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789478348.207762:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964355968 00000100:00100000:3.0:1789478348.207848:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964355968 00000100:00100000:3.0:1789478348.207897:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789478348.207981:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc08741d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876403964355968:12345-0@lo:38: 00010000:00080000:3.0:1789478348.208019:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:3.0:1789478348.208641:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x8ebaae74e8215ab6 00000004:00100000:3.0:1789478348.208665:0:6518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789478348.208700:0:6518:0:(import.c:65:import_set_state_nolock()) 000000007ee590e2 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789478348.209425:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc08741d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876403964355968:12345-0@lo:38: Request processed in 1450us (3944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478348.209436:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789478348.209456:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002ab9669b x1876403964355968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789478358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478348.209469:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789478348.209478:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789478348.209485:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789478348.209490:0:3644:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789478348.209493:0:3644:0:(import.c:65:import_set_state_nolock()) 0000000066a59d89 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789478348.209499:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ab9669b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876403964355968:0@lo:38: 00000040:00080000:1.0:1789478348.210165:0:7469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1789478348.210314:0:7446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1789478348.210343:0:7446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789478348.210359:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 0000000042e865bd/0x8ebaae74e8215a85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215a93 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.210369:0:7446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 0000000042e865bd/0x8ebaae74e8215a85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215a93 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789478348.210410:0:7446:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789478348.210412:0:7446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789478348.210413:0:7446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478348.210414:0:7446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478348.210415:0:7446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478348.210416:0:7446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478348.210418:0:7446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789478348.210419:0:7446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789478348.210420:0:7446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789478348.210422:0:7446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478348.210427:0:7446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789478348.210430:0:7446:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1789478348.210433:0:7446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789478348.210434:0:7446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789478348.210435:0:7446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478348.210435:0:7446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478348.210436:0:7446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478348.210437:0:7446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478348.210438:0:7446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789478348.210439:0:7446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789478348.210440:0:7446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789478348.210441:0:7446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478348.210441:0:7446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789478348.210460:0:7446:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789478348.210473:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000055047779 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964356096:0@lo:253: 00000100:00100000:2.0:1789478348.210524:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478348.210551:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000995ae7a6 going to sleep for 11 seconds 00000100:00100000:3.0:1789478348.210946:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964356096 00000100:00100000:3.0:1789478348.210954:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964356096 00000100:00100000:3.0:1789478348.211031:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789478348.211039:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000711f9d25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+18:7446:x1876403964356096:12345-0@lo:253: 20000000:01000000:3.0:1789478348.211065:0:6510:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789478348.211077:0:6510:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 40000000:00080000:3.0:1789478348.211219:0:7471:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000001:00100000:2.0:1789478348.214801:0:6496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1789478348.214878:0:6510:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789478348.214895:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1789478348.214915:0:6533:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789478348.214919:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789478348.214937:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009dadc412/0x8ebaae74e8215abd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.214954:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000084a27830/0x8ebaae74e821599e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215997 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.214961:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000c4b9469/0x8ebaae74e8215a62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215a5b expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.214967:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009dadc412/0x8ebaae74e8215abd lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.215002:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000c4b9469/0x8ebaae74e8215a62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215a5b expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.215014:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000c4b9469/0x8ebaae74e8215a62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215a5b expref: 18 pid: 6512 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478348.215026:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8be1764 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1876403964356224:0@lo:104: 00000100:00100000:0.0:1789478348.215091:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789478348.215142:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000084a27830/0x8ebaae74e821599e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215997 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.215150:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000084a27830/0x8ebaae74e821599e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215997 expref: 18 pid: 6512 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478348.215158:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002130db52 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1876403964356352:0@lo:104: 00000100:00100000:3.0:1789478348.215188:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964356224 00000100:00100000:0.0:1789478348.215190:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478348.215195:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964356224 00000100:00100000:0.0:1789478348.215220:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set 0000000057624646 going to sleep for 11 seconds 00000100:00100000:3.0:1789478348.215226:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964356352 00000100:00100000:3.0:1789478348.215229:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964356352 00000100:00100000:3.0:1789478348.215242:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789478348.215249:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000defc6b49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+4:6533:x1876403964356224:12345-0@lo:104: 00010000:00010000:3.0:1789478348.215261:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: 00000000ab5ee7e5/0x8ebaae74e8215a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215a62 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.215317:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789478348.215323:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000defc6b49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+4:6533:x1876403964356224:12345-0@lo:104: Request processed in 75us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478348.215329:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789478348.215342:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8be1764 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1876403964356224:0@lo:104: 00000100:00100000:3.0:1789478348.215344:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789478348.215361:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4940c2a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+3:6533:x1876403964356352:12345-0@lo:104: 00010000:00010000:3.0:1789478348.215374:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: 00000000fe1e6f0d/0x8ebaae74e8215997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e821599e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.215416:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789478348.215421:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4940c2a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+3:6533:x1876403964356352:12345-0@lo:104: Request processed in 62us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478348.215427:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789478348.215442:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1789478348.215445:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002130db52 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1876403964356352:0@lo:104: 00010000:00010000:3.0:1789478348.215446:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: 00000000ab5ee7e5/0x8ebaae74e8215a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215a62 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.215452:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ab5ee7e5 already unused, calling callback (00000000ec062f3f) 10000000:00010000:3.0:1789478348.215455:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: 00000000ab5ee7e5/0x8ebaae74e8215a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215a62 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.215461:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009dadc412/0x8ebaae74e8215abd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.215462:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: 00000000ab5ee7e5/0x8ebaae74e8215a5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215a62 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789478348.215468:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: 00000000ab5ee7e5/0x8ebaae74e8215a5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215a62 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478348.215474:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789478348.215584:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: 00000000ab5ee7e5/0x8ebaae74e8215a5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215a62 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.215617:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789478348.215716:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: 00000000ab5ee7e5/0x8ebaae74e8215a5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215a62 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.215723:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: 00000000ab5ee7e5/0x8ebaae74e8215a5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215a62 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.215740:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789478348.215743:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: 00000000fe1e6f0d/0x8ebaae74e8215997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e821599e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.215747:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fe1e6f0d already unused, calling callback (00000000ec062f3f) 10000000:00010000:3.0:1789478348.215749:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: 00000000fe1e6f0d/0x8ebaae74e8215997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e821599e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.215754:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: 00000000fe1e6f0d/0x8ebaae74e8215997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e821599e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789478348.215759:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: 00000000fe1e6f0d/0x8ebaae74e8215997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e821599e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478348.215763:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1789478348.215807:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f188e3d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964356480:0@lo:103: 00000100:00100000:2.0:1789478348.215835:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478348.215875:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964356480 00000100:00100000:2.0:1789478348.215879:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964356480 00010000:00010000:2.0:1789478348.215897:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000c4b9469/0x8ebaae74e8215a62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215a5b expref: 19 pid: 6512 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478348.215915:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789478348.215920:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b7e354 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+19:3648:x1876403964356480:12345-0@lo:103: 00010000:00010000:2.0:1789478348.215930:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478348.215933:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000c4b9469/0x8ebaae74e8215a62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215a5b expref: 19 pid: 6512 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.215941:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000c4b9469/0x8ebaae74e8215a62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215a5b expref: 19 pid: 6512 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.215964:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000c4b9469/0x8ebaae74e8215a62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215a5b expref: 19 pid: 6512 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478348.215974:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478348.216001:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b7e354 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+18:3648:x1876403964356480:12345-0@lo:103: Request processed in 81us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478348.216007:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789478348.216031:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f188e3d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964356480:0@lo:103: 00010000:00010000:1.0:1789478348.216110:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478348.216170:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000711f9d25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+17:7446:x1876403964356096:12345-0@lo:253: Request processed in 5132us (5647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478348.216190:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789478348.216374:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000055047779 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:7446:1876403964356096:0@lo:253: 10000000:01000000:2.0:1789478348.216384:0:7446:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789478348.216387:0:7446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789478348.216388:0:7446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789478348.216390:0:7446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478348.216391:0:7446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478348.216392:0:7446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478348.216394:0:7446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478348.216395:0:7446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789478348.216397:0:7446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789478348.216398:0:7446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789478348.216399:0:7446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478348.216400:0:7446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789478348.216408:0:7446:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789478348.218387:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: 00000000fe1e6f0d/0x8ebaae74e8215997 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e821599e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.218403:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789478348.218437:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: 00000000fe1e6f0d/0x8ebaae74e8215997 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e821599e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.218444:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: 00000000fe1e6f0d/0x8ebaae74e8215997 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e821599e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.218461:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478348.218462:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d06cfcf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964356608:0@lo:103: 00010000:00010000:3.0:1789478348.218463:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478348.218465:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478348.218518:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478348.218543:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964356608 00000100:00100000:0.0:1789478348.218551:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964356608 00010000:00010000:0.0:1789478348.218575:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000084a27830/0x8ebaae74e821599e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215997 expref: 17 pid: 6512 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478348.218622:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789478348.218634:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022c1126d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+17:3645:x1876403964356608:12345-0@lo:103: 00010000:00010000:0.0:1789478348.218663:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478348.218777:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000084a27830/0x8ebaae74e821599e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215997 expref: 17 pid: 6512 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.218788:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000084a27830/0x8ebaae74e821599e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215997 expref: 17 pid: 6512 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.218811:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000084a27830/0x8ebaae74e821599e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215997 expref: 17 pid: 6512 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.218824:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009dadc412/0x8ebaae74e8215abd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.218830:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009dadc412/0x8ebaae74e8215abd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789478348.218843:0:6502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003923730s 00010000:00010000:0.0:1789478348.218847:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009dadc412/0x8ebaae74e8215abd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.218853:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009dadc412/0x8ebaae74e8215abd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.218858:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009dadc412/0x8ebaae74e8215abd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.218864:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009dadc412/0x8ebaae74e8215abd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.218869:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009dadc412 already unused, calling callback (00000000d680f8d5) 00010000:00010000:0.0:1789478348.218872:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009dadc412/0x8ebaae74e8215abd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.218879:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009dadc412/0x8ebaae74e8215abd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.218897:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009dadc412/0x8ebaae74e8215abd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478348.218917:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478348.218960:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022c1126d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:3645:x1876403964356608:12345-0@lo:103: Request processed in 332us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478348.218967:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789478348.218985:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d06cfcf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964356608:0@lo:103: 00010000:00010000:3.0:1789478348.219036:0:6533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009dadc412/0x8ebaae74e8215abd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.219049:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009dadc412/0x8ebaae74e8215abd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478348.219054:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009dadc412/0x8ebaae74e8215abd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1789478348.222466:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1789478348.223080:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789478348.223316:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1789478348.223533:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789478348.223984:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1789478348.224134:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1789478348.224989:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789478348.225252:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1789478348.225437:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1789478348.225876:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1789478348.226060:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1789478348.226249:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1789478348.228141:0:7446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1789478348.228379:0:7475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1789478348.228426:0:7475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b7fb005 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1876403964356736:0@lo:700: 00000100:00100000:3.0:1789478348.228488:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478348.228556:0:7475:0:(client.c:2715:ptlrpc_set_wait()) set 000000008f116957 going to sleep for 11 seconds 00000020:00080000:1.0:1789478348.228558:0:7474:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1789478348.228562:0:7474:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1789478348.228622:0:7446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1789478348.228990:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964356736 00000100:00100000:2.0:1789478348.228999:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964356736 00000100:00100000:2.0:1789478348.229048:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789478348.229056:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002aac0d85 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1876403964356736:12345-0@lo:700: 00000100:00100000:1.0:1789478348.229192:0:7476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036f0cc69 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876403964356864:0@lo:1000: 00000100:00100000:1.0:1789478348.229230:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478348.229261:0:7476:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e138df04 going to sleep for 11 seconds 00000100:00100000:0.0:1789478348.229316:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964356864 00000100:00100000:0.0:1789478348.229321:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964356864 00000100:00100000:0.0:1789478348.229358:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789478348.229364:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003472a564 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1876403964356864:12345-0@lo:1000: 00000100:00100000:0.0:1789478348.229440:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003472a564 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1876403964356864:12345-0@lo:1000: Request processed in 76us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478348.229448:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789478348.229519:0:7476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036f0cc69 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876403964356864:0@lo:1000: 00000040:01000000:1.0:1789478348.229553:0:7476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1789478348.229573:0:7476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036f0cc69 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876403964356992:0@lo:700: 00000100:00100000:1.0:1789478348.229612:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478348.229639:0:7476:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ea609703 going to sleep for 11 seconds 00000100:00100000:0.0:1789478348.229704:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964356992 00000100:00100000:0.0:1789478348.229708:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964356992 00000100:00100000:0.0:1789478348.229737:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789478348.229742:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fa14247 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1876403964356992:12345-0@lo:700: 00000100:00100000:0.0:1789478348.229784:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fa14247 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1876403964356992:12345-0@lo:700: Request processed in 42us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478348.229790:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789478348.229816:0:7476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036f0cc69 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876403964356992:0@lo:700: 00000100:00100000:0.0:1789478348.229849:0:7476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8d4b4e0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1876403964357120:0@lo:900: 00000100:00100000:0.0:1789478348.229886:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478348.229911:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964357120 00000100:00100000:0.0:1789478348.229914:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964357120 00000100:00100000:0.0:1789478348.229935:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789478348.229949:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002130db52 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1876403964357120:12345-0@lo:900: 00000100:00100000:0.0:1789478348.229979:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002130db52 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1876403964357120:12345-0@lo:900: Request processed in 32us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478348.229985:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789478348.230004:0:7476:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dd999379 going to sleep for 11 seconds 00010000:00080000:0.0:1789478348.230017:0:7476:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e8d4b4e0 x1876403964357120/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789478364 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478348.230026:0:7476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8d4b4e0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1876403964357120:0@lo:900: 00000100:00100000:0.0:1789478348.230090:0:7476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8d4b4e0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876403964357248:0@lo:1000: 00000100:00100000:0.0:1789478348.230115:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478348.230134:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964357248 00000100:00100000:0.0:1789478348.230137:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964357248 00000100:00100000:0.0:1789478348.230153:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789478348.230158:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8be1764 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1876403964357248:12345-0@lo:1000: 00000100:00100000:0.0:1789478348.230211:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8be1764 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1876403964357248:12345-0@lo:1000: Request processed in 53us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478348.230216:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789478348.230231:0:7476:0:(client.c:2715:ptlrpc_set_wait()) set 000000001b2361c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478348.230244:0:7476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8d4b4e0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876403964357248:0@lo:1000: 00000004:00080000:0.0:1789478348.230276:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000dd999379 with version 0 00000020:00100000:0.0:1789478348.230289:0:7476:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789478348.230294:0:7476:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e8d4b4e0 x1876403964357504/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789478348.230305:0:7476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8d4b4e0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876403964357504:0@lo:1000: 00000100:00100000:0.0:1789478348.230326:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478348.230352:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964357504 00000100:00100000:0.0:1789478348.230355:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964357504 00000100:00100000:0.0:1789478348.230371:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789478348.230375:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000776da945 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1876403964357504:12345-0@lo:1000: 00000100:00100000:0.0:1789478348.230684:0:7476:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e84d626 going to sleep for 11 seconds 00000040:01000000:3.0:1789478348.231359:0:7446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1789478348.231469:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789478348.232220:0:7446:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789478348.232229:0:7446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1789478348.232372:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789478348.233937:0:7446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789478348.234487:0:7446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789478348.234516:0:7446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1789478348.234884:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789478348.235062:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1789478348.235949:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789478348.236086:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1789478348.236233:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789478348.236406:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789478348.236562:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789478348.236992:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789478348.237135:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789478348.237281:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789478348.237420:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789478348.237540:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789478348.237877:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789478348.238007:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789478348.238132:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789478348.238268:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789478348.238414:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789478348.238535:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789478348.239009:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789478348.239117:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789478348.239256:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789478348.239408:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789478348.239539:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789478348.239997:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789478348.240170:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00000001:00080000:1.0:1789478348.242238:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:2.0:1789478348.242419:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000776da945 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1876403964357504:12345-0@lo:1000: Request processed in 12039us (12088us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789478348.242431:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000004:00080000:1.0:1789478348.242516:0:7476:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1789478348.242521:0:7476:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789478348.242536:0:7476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8d4b4e0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876403964357504:0@lo:1000: 40000000:02000000:3.0:1789478348.242547:0:6524:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:1.0:1789478348.242645:0:7476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ea4b24f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876403964357632:0@lo:1000: 00000100:00100000:1.0:1789478348.242804:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478348.242847:0:7476:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dd999379 going to sleep for 11 seconds 00000100:00100000:2.0:1789478348.242897:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964357632 00000100:00100000:2.0:1789478348.242903:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964357632 00000100:00100000:2.0:1789478348.242939:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789478348.242947:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a72c978 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1876403964357632:12345-0@lo:1000: 00000100:00100000:2.0:1789478348.243017:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a72c978 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1876403964357632:12345-0@lo:1000: Request processed in 72us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478348.243024:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789478348.243275:0:7476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ea4b24f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876403964357632:0@lo:1000: 00000040:00080000:1.0:1789478348.243293:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1789478348.243321:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000002e84d626 with version 1 00000040:00080000:1.0:1789478348.245485:0:7476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789478348.245563:0:7476:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:0.0:1789478348.248091:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789478348.248284:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789478348.248425:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789478348.248580:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789478348.248825:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789478348.248974:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789478348.249110:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789478348.249267:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789478348.249435:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789478348.249660:0:7446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000004:00080000:2.0:1789478348.249870:0:7462:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000d5ebf6ee version 1 rpc_version 1 00000020:00100000:2.0:1789478348.249918:0:7462:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789478348.249927:0:7462:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000055047779 x1876403964357888/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789478348.249947:0:7462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000055047779 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7462:1876403964357888:0@lo:1000: 00000100:00100000:2.0:1789478348.250008:0:7462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478348.250045:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964357888 00000100:00100000:2.0:1789478348.250052:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964357888 00000100:00100000:2.0:1789478348.250090:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789478348.250099:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020c30ad8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7462:x1876403964357888:12345-0@lo:1000: 00000100:00100000:2.0:1789478348.250247:0:7462:0:(client.c:2715:ptlrpc_set_wait()) set 000000007580db50 going to sleep for 11 seconds 00000100:00100000:3.0:1789478348.254164:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002aac0d85 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1876403964356736:12345-0@lo:700: Request processed in 25101us (25669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478348.254192:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:1.0:1789478348.255547:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:0.0:1789478348.255722:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020c30ad8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7462:x1876403964357888:12345-0@lo:1000: Request processed in 5622us (5712us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789478348.255733:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:3.0:1789478348.255867:0:7462:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1789478348.255872:0:7462:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789478348.255888:0:7462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000055047779 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7462:1876403964357888:0@lo:1000: 00010000:00080000:2.0:1789478348.256351:0:7475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009b7fb005 x1876403964356736/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789478364 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478348.256364:0:7475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b7fb005 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1876403964356736:0@lo:700: 40000000:02000000:2.0:1789478348.256373:0:7475:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:0.0:1789478348.262284:0:7446:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789478348.262319:0:7446:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9dd901c73988 00100000:10000000:0.0:1789478348.262327:0:7446:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1789478348.263225:0:7446:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789478348.263253:0:7446:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789478348.263270:0:7446:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789478348.263283:0:7446:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1789478348.264012:0:7446:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789478348.264223:0:7446:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:3.0:1789478348.283391:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789478348.289192:0:7475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789478348.289263:0:7475:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789478348.289268:0:7475:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1789478348.325458:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478349.220648:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 0000000058657989 going to sleep for 0 seconds 00010000:00010000:1.0:1789478349.349996:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478350.244688:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 0000000058657989 going to sleep for 0 seconds 00010000:00010000:1.0:1789478350.372896:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478351.272444:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 0000000058657989 going to sleep for 0 seconds 00010000:00010000:1.0:1789478351.407767:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478352.298353:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 0000000058657989 going to sleep for 0 seconds 00000001:02000400:0.0:1789478352.390133:0:7720:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789478352.426277:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789478353.243100:0:7773:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789478353.243487:0:7773:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789478353.317865:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 0000000058657989 going to sleep for 0 seconds 00010000:00010000:2.0:1789478353.446163:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478353.636718:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789478353.636737:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000658e66a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964358016:0@lo:41: 00000100:00100000:2.0:1789478353.636820:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478353.636888:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964358016 00000100:00100000:2.0:1789478353.636895:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964358016 00000100:00100000:2.0:1789478353.636930:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789478353.636937:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055047779 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964358016:12345-0@lo:41: 00000004:00000024:2.0:1789478353.636967:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1789478353.637004:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055047779 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964358016:12345-0@lo:41: Request processed in 68us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478353.637023:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789478353.637067:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000658e66a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964358016:0@lo:41: 00000100:00080000:2.0:1789478353.640048:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789478353.640057:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789478353.640060:0:38:0:(import.c:65:import_set_state_nolock()) 00000000590e9c98 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789478353.640083:0:38:0:(import.c:625:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000590e9c98 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1789478353.640101:0:38:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c5b7e354 x1876403964358400/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789478353.640138:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c5b7e354 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964358400:0@lo:38: 00000100:00100000:2.0:1789478353.640212:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478353.640253:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964358400 00000100:00100000:2.0:1789478353.640260:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964358400 00000100:00100000:2.0:1789478353.640284:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789478353.640290:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073a2fa4c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876403964358400:12345-0@lo:38: 00010000:00080000:2.0:1789478353.640312:0:6523:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:2.0:1789478353.640351:0:6523:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8ebaae74e8215ac4 00000004:00100000:2.0:1789478353.640364:0:6523:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789478353.640368:0:6523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1789478353.640423:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b1ca62a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964358528:0@lo:400: 00000100:00100000:2.0:1789478353.640448:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478353.640480:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964358528 00000100:00100000:2.0:1789478353.640483:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964358528 00000100:00100000:2.0:1789478353.640505:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789478353.640510:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0a93f71 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964358528:12345-0@lo:400: 00000100:00100000:2.0:1789478353.640546:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0a93f71 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964358528:12345-0@lo:400: Request processed in 36us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478353.640840:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789478353.640875:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000b1ca62a0 x1876403964358528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478353.640887:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b1ca62a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964358528:0@lo:400: 00000100:00100000:0.0:1789478353.640965:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000018e97395 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876403964358272:0@lo:400: 00000100:00100000:0.0:1789478353.640994:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478353.641025:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789478353.641030:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000658e66a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964358144:0@lo:400: 00000100:00100000:0.0:1789478353.641053:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478353.641079:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964358144 00000100:00100000:0.0:1789478353.641082:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964358144 00000100:00100000:0.0:1789478353.641107:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789478353.641112:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002660395a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:3648:x1876403964358144:12345-0@lo:400: 00000100:00100000:0.0:1789478353.641140:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002660395a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:3648:x1876403964358144:12345-0@lo:400: Request processed in 29us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478353.641159:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789478353.641194:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000658e66a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964358144:0@lo:400: 00000100:00100000:3.0:1789478353.644801:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964358272 00000100:00100000:3.0:1789478353.644824:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964358272 00000100:00100000:3.0:1789478353.644876:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789478353.644883:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8d4b4e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876403964358272:12345-0@lo:400: 00000100:00100000:3.0:1789478353.644968:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8d4b4e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876403964358272:12345-0@lo:400: Request processed in 86us (3973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478353.644975:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789478353.645240:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000018e97395 x1876403964358272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478353.645254:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000018e97395 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876403964358272:0@lo:400: 00000100:00080000:2.0:1789478353.650299:0:6523:0:(import.c:65:import_set_state_nolock()) 0000000005678ecd : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789478353.650375:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073a2fa4c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876403964358400:12345-0@lo:38: Request processed in 10083us (10162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478353.650384:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789478353.650434:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789478353.650447:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789478353.650452:0:3644:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789478353.650454:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000590e9c98 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789478353.650465:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000058657989): req@0000000031a53516 x1876403964355200/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478353.650478:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c5b7e354 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964358400:0@lo:38: 00000100:00100000:1.0:1789478353.650997:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478353.651027:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 0000000058657989 going to sleep for 11 seconds 00000100:00100000:1.0:1789478353.651045:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964355200 00000100:00100000:1.0:1789478353.651049:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964355200 00000100:00100000:1.0:1789478353.651079:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789478353.651091:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3aace68 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7468:x1876403964355200:12345-0@lo:1000: 00000100:00100000:1.0:1789478353.651160:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3aace68 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7468:x1876403964355200:12345-0@lo:1000: Request processed in 71us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478353.651167:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789478353.651191:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000031a53516 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7468:1876403964355200:0@lo:1000: 00000040:01000000:1.0:1789478353.651217:0:7468:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789478353.651242:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036f0cc69 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7468:1876403964358784:0@lo:1000: 00000100:00100000:1.0:1789478353.651267:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478353.651287:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b530bfca going to sleep for 11 seconds 00000100:00100000:1.0:1789478353.651296:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964358784 00000100:00100000:1.0:1789478353.651298:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964358784 00000100:00100000:1.0:1789478353.651312:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789478353.651317:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026f05915 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7468:x1876403964358784:12345-0@lo:1000: 00000100:00100000:1.0:1789478353.651389:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026f05915 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7468:x1876403964358784:12345-0@lo:1000: Request processed in 71us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478353.651394:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789478353.651413:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036f0cc69 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7468:1876403964358784:0@lo:1000: 00000100:00100000:1.0:1789478353.651441:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036f0cc69 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7468:1876403964358912:0@lo:700: 00000100:00100000:1.0:1789478353.651461:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478353.651473:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079e40c4e going to sleep for 11 seconds 00000100:00100000:1.0:1789478353.651487:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964358912 00000100:00100000:1.0:1789478353.651489:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964358912 00000100:00100000:1.0:1789478353.651509:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789478353.651514:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001d2d5af pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7468:x1876403964358912:12345-0@lo:700: 00000100:00100000:1.0:1789478353.651544:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001d2d5af pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7468:x1876403964358912:12345-0@lo:700: Request processed in 31us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478353.652072:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789478353.652102:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036f0cc69 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7468:1876403964358912:0@lo:700: 00000100:00100000:1.0:1789478353.652189:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036f0cc69 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7468:1876403964359040:0@lo:1000: 00000100:00100000:1.0:1789478353.652226:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478353.652239:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 00000000670016e5 going to sleep for 11 seconds 00000100:00100000:1.0:1789478353.652350:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964359040 00000100:00100000:1.0:1789478353.652354:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964359040 00000100:00100000:1.0:1789478353.652371:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789478353.652376:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ab9669b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7468:x1876403964359040:12345-0@lo:1000: 00000100:00100000:1.0:1789478353.652420:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ab9669b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7468:x1876403964359040:12345-0@lo:1000: Request processed in 44us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478353.652426:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789478353.652439:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789478353.652446:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ea4b24f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964358656:0@lo:41: 00000100:00100000:1.0:1789478353.652464:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478353.652482:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964358656 00000100:00100000:1.0:1789478353.652485:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964358656 00000100:00100000:1.0:1789478353.652497:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789478353.652501:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ab95c05 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876403964358656:12345-0@lo:41: 00000004:00000024:1.0:1789478353.652518:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789478353.652544:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ab95c05 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876403964358656:12345-0@lo:41: Request processed in 43us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478353.652549:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789478353.653741:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ea4b24f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964358656:0@lo:41: 00000100:00100000:1.0:1789478353.653770:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036f0cc69 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7468:1876403964359040:0@lo:1000: 00000004:00080000:1.0:1789478353.653818:0:7468:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000079e40c4e with version 0 00000020:00100000:1.0:1789478353.654715:0:7468:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789478353.654721:0:7468:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000036f0cc69 x1876403964359296/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789478353.654737:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036f0cc69 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7468:1876403964359296:0@lo:1000: 00000100:00100000:1.0:1789478353.654774:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478353.654793:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 0000000040b8dede going to sleep for 11 seconds 00000100:00100000:2.0:1789478353.655045:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964359296 00000100:00100000:2.0:1789478353.655052:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964359296 00000100:00100000:2.0:1789478353.655086:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789478353.655092:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ea4b24f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7468:x1876403964359296:12345-0@lo:1000: 00000001:00080000:1.0:1789478353.661164:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1789478353.661177:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789478353.679694:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ea4b24f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7468:x1876403964359296:12345-0@lo:1000: Request processed in 24595us (24912us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789478353.679708:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1789478353.686134:0:7468:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1789478353.686142:0:7468:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789478353.686169:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036f0cc69 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7468:1876403964359296:0@lo:1000: 00000100:00100000:1.0:1789478353.686248:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036f0cc69 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7468:1876403964359424:0@lo:1000: 00000100:00100000:1.0:1789478353.686299:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478353.686334:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b530bfca going to sleep for 11 seconds 00000100:00100000:2.0:1789478353.686400:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964359424 00000100:00100000:2.0:1789478353.686406:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964359424 00000100:00100000:2.0:1789478353.686478:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789478353.686485:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013061189 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7468:x1876403964359424:12345-0@lo:1000: 00000100:00100000:2.0:1789478353.686566:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013061189 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7468:x1876403964359424:12345-0@lo:1000: Request processed in 82us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478353.686573:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789478353.686679:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036f0cc69 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7468:1876403964359424:0@lo:1000: 00000040:00080000:3.0:1789478353.686694:0:7468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1789478353.686722:0:7468:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000bbe7b969 with version 1 00000040:00080000:3.0:1789478353.689235:0:7468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789478353.689300:0:7468:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 5, retries 0 00000004:00080000:3.0:1789478353.689305:0:7468:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:3.0:1789478353.689388:0:7465:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000005d4d7e4 version 1 rpc_version 1 00000020:00100000:3.0:1789478353.689417:0:7465:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789478353.689425:0:7465:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000031a53516 x1876403964359680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789478353.689442:0:7465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000031a53516 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7465:1876403964359680:0@lo:1000: 00000100:00100000:3.0:1789478353.690057:0:7465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478353.690198:0:7465:0:(client.c:2715:ptlrpc_set_wait()) set 00000000166926e0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478353.690269:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964359680 00000100:00100000:1.0:1789478353.690276:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964359680 00000100:00100000:1.0:1789478353.690308:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789478353.690314:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b7fb005 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7465:x1876403964359680:12345-0@lo:1000: 00000001:00080000:1.0:1789478353.697731:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1789478353.697999:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b7fb005 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7465:x1876403964359680:12345-0@lo:1000: Request processed in 7681us (7989us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789478353.698019:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:1.0:1789478353.698093:0:7465:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1789478353.698098:0:7465:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789478353.698112:0:7465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000031a53516 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7465:1876403964359680:0@lo:1000: 00010000:00010000:1.0:1789478354.470432:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478355.493770:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789478355.847973:0:7874:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789478355.848195:0:7874:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789478356.525220:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789478356.960098:0:7922:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea966abf0 20000000:00000080:2.0:1789478356.960115:0:7922:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ebc34fd7800 uarg=0000000000000000 20000000:01000000:2.0:1789478356.960174:0:7922:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789478356.960182:0:7922:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789478356.960186:0:7922:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789478356.960251:0:7922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1789478356.960267:0:7922:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1789478356.991020:0:7922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789478356.991502:0:7922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789478356.991535:0:7922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1789478356.991552:0:7922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1789478356.991565:0:7922:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789478356.991581:0:7922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000088766473/0x8ebaae74e8215acb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478356.991728:0:7922:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005372202c/0x8ebaae74e8215966 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e821595f expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478356.991734:0:7922:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ce317a75/0x8ebaae74e8215a7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215a77 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478356.991740:0:7922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000088766473/0x8ebaae74e8215acb lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478356.991842:0:7922:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ce317a75/0x8ebaae74e8215a7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215a77 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478356.991856:0:7922:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ce317a75/0x8ebaae74e8215a7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215a77 expref: 15 pid: 6510 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478356.991869:0:7922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d06cfcf pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1876403964359808:0@lo:104: 00000100:00100000:3.0:1789478356.991929:0:7922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789478356.992018:0:7922:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005372202c/0x8ebaae74e8215966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e821595f expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478356.992025:0:7922:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005372202c/0x8ebaae74e8215966 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e821595f expref: 15 pid: 6510 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478356.992033:0:7922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000065b365e6 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1876403964359936:0@lo:104: 00000100:00100000:3.0:1789478356.992052:0:7922:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e84d626 going to sleep for 11 seconds 00000100:00100000:2.0:1789478356.992367:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789478356.992386:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478356.992428:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964359808 00000100:00100000:2.0:1789478356.992435:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964359808 00000100:00100000:2.0:1789478356.992466:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964359936 00000100:00100000:2.0:1789478356.992469:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964359936 00000100:00100000:2.0:1789478356.992482:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789478356.992489:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef19a90a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+4:7922:x1876403964359808:12345-0@lo:104: 00010000:00010000:2.0:1789478356.992500:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e8215a77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215a7e expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478356.992626:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789478356.992639:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789478356.992642:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef19a90a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+4:7922:x1876403964359808:12345-0@lo:104: Request processed in 143us (704us total) trans 0 rc 0/0 00010000:00010000:1.0:1789478356.992644:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e8215a77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215a7e expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478356.992649:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789478356.992665:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007c1ae027 already unused, calling callback (00000000ec062f3f) 10000000:00010000:1.0:1789478356.992668:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e8215a77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215a7e expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478356.992675:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e8215a77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215a7e expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478356.992681:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e8215a77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215a7e expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478356.992685:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789478356.992717:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e8215a77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215a7e expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478356.992722:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789478356.992731:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789478356.992736:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b7e354 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+3:7922:x1876403964359936:12345-0@lo:104: 00010000:00010000:1.0:1789478356.992741:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e8215a77 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215a7e expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478356.992743:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: 00000000ab8a91c8/0x8ebaae74e821595f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215966 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478356.992747:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: 000000007c1ae027/0x8ebaae74e8215a77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215a7e expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478356.992759:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478356.992761:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478356.992762:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478356.992772:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004353e414 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964360064:0@lo:103: 00010000:00010000:2.0:1789478356.992789:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789478356.992793:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b7e354 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+3:7922:x1876403964359936:12345-0@lo:104: Request processed in 58us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478356.992798:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478356.992799:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1789478356.992838:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789478356.992842:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: 00000000ab8a91c8/0x8ebaae74e821595f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215966 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478356.992848:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ab8a91c8 already unused, calling callback (00000000ec062f3f) 10000000:00010000:1.0:1789478356.992850:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: 00000000ab8a91c8/0x8ebaae74e821595f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215966 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478356.992856:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: 00000000ab8a91c8/0x8ebaae74e821595f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215966 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478356.992861:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: 00000000ab8a91c8/0x8ebaae74e821595f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215966 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478356.992865:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789478356.992879:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: 00000000ab8a91c8/0x8ebaae74e821595f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215966 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478356.992885:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789478356.992905:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: 00000000ab8a91c8/0x8ebaae74e821595f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215966 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478356.992911:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: 00000000ab8a91c8/0x8ebaae74e821595f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215966 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478356.992924:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478356.992926:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478356.992927:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478356.992936:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964360064 00000100:00100000:1.0:1789478356.992940:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964360064 00000100:00100000:2.0:1789478356.992951:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7299b07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964360192:0@lo:103: 00010000:00010000:1.0:1789478356.992956:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ce317a75/0x8ebaae74e8215a7e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215a77 expref: 16 pid: 6510 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478356.992974:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478356.993034:0:7922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d06cfcf pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1876403964359808:0@lo:104: 00000100:00100000:3.0:1789478356.993043:0:7922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000065b365e6 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1876403964359936:0@lo:104: 00010000:00010000:3.0:1789478356.993059:0:7922:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000088766473/0x8ebaae74e8215acb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478357.002194:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964360192 00000100:00100000:1.0:1789478357.002208:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964360192 00010000:00010000:1.0:1789478357.002244:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005372202c/0x8ebaae74e8215966 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e821595f expref: 17 pid: 6510 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478357.002274:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789478357.002281:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004dacbfd3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+17:3647:x1876403964360064:12345-0@lo:103: 00010000:00010000:1.0:1789478357.002295:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478357.002300:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ce317a75/0x8ebaae74e8215a7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215a77 expref: 17 pid: 6510 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478357.002310:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ce317a75/0x8ebaae74e8215a7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215a77 expref: 17 pid: 6510 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478357.002326:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ce317a75/0x8ebaae74e8215a7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215a77 expref: 17 pid: 6510 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478357.002341:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478357.002475:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004dacbfd3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+16:3647:x1876403964360064:12345-0@lo:103: Request processed in 194us (9675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478357.002483:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789478357.002500:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789478357.002506:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004bd30cdd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+15:3648:x1876403964360192:12345-0@lo:103: 00010000:00010000:1.0:1789478357.002514:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478357.002517:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005372202c/0x8ebaae74e8215966 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e821595f expref: 15 pid: 6510 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478357.002525:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005372202c/0x8ebaae74e8215966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e821595f expref: 15 pid: 6510 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478357.002546:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005372202c/0x8ebaae74e8215966 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e821595f expref: 15 pid: 6510 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478357.002557:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000088766473/0x8ebaae74e8215acb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478357.002564:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000088766473/0x8ebaae74e8215acb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478357.002576:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000088766473/0x8ebaae74e8215acb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478357.002582:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000088766473/0x8ebaae74e8215acb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478357.002587:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000088766473/0x8ebaae74e8215acb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478357.002608:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000088766473/0x8ebaae74e8215acb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478357.002613:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000088766473 already unused, calling callback (00000000d680f8d5) 00010000:00010000:1.0:1789478357.002616:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000088766473/0x8ebaae74e8215acb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478357.002622:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000088766473/0x8ebaae74e8215acb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478357.002636:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000088766473/0x8ebaae74e8215acb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478357.004639:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478357.004811:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004bd30cdd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+14:3648:x1876403964360192:12345-0@lo:103: Request processed in 2302us (11832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478357.004822:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789478357.005247:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7299b07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964360192:0@lo:103: 00000100:00100000:2.0:1789478357.005340:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004353e414 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964360064:0@lo:103: 00010000:00010000:2.0:1789478357.005395:0:7922:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000088766473/0x8ebaae74e8215acb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478357.005405:0:7922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000088766473/0x8ebaae74e8215acb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478357.005411:0:7922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000088766473/0x8ebaae74e8215acb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478357.468701:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789478357.468709:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ebc34d64800 from 4 10000000:01000000:0.0:1789478357.468728:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789478357.468767:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 000000009533230e/0x8ebaae74e8215ad2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478357.468778:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 000000009533230e/0x8ebaae74e8215ad2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478357.468789:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 000000009533230e/0x8ebaae74e8215ad2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478357.468811:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ac02b4c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964360320:0@lo:101: 00000100:00100000:0.0:1789478357.468869:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478357.468916:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c4e4e6eb going to sleep for 11 seconds 00000100:00100000:1.0:1789478357.470054:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964360320 00000100:00100000:1.0:1789478357.470065:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964360320 00000100:00100000:1.0:1789478357.470141:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789478357.470151:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004889bfcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+14:6514:x1876403964360320:12345-0@lo:101: 00010000:00010000:1.0:1789478357.470163:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478357.470177:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003d694560/0x8ebaae74e8215ad9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215ad2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478357.470198:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003d694560/0x8ebaae74e8215ad9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215ad2 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478357.470207:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003d694560/0x8ebaae74e8215ad9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215ad2 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478357.470216:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003d694560, rc 0) 00000100:00100000:1.0:1789478357.470277:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004889bfcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+15:6514:x1876403964360320:12345-0@lo:101: Request processed in 128us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478357.470284:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789478357.470652:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ac02b4c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964360320:0@lo:101: 00010000:00010000:2.0:1789478357.470669:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 000000009533230e/0x8ebaae74e8215ad2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215ad9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478357.470678:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 000000009533230e/0x8ebaae74e8215ad2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215ad9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478357.470735:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e7a72481 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964360448:0@lo:256: 00000100:00100000:2.0:1789478357.470772:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478357.470804:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ee93588e going to sleep for 11 seconds 00000100:00100000:0.0:1789478357.470917:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964360448 00000100:00100000:0.0:1789478357.470933:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964360448 00000100:00100000:0.0:1789478357.470967:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789478357.470974:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000522a39fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+15:6514:x1876403964360448:12345-0@lo:256: 20000000:01000000:0.0:1789478357.470986:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789478357.471011:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789478357.471014:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789478357.471092:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000522a39fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+15:6514:x1876403964360448:12345-0@lo:256: Request processed in 118us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478357.471100:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789478357.471347:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e7a72481 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964360448:0@lo:256: 10000000:01000000:2.0:1789478357.471384:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789478357.471389:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 000000009533230e/0x8ebaae74e8215ad2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215ad9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478357.471396:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 000000009533230e/0x8ebaae74e8215ad2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215ad9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478357.471403:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789478357.471410:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebc34d64800 from 1 10000000:01000000:2.0:1789478357.471413:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789478357.471433:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 000000000c4b9469/0x8ebaae74e8215ae0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478357.471439:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 000000000c4b9469/0x8ebaae74e8215ae0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478357.471446:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 000000000c4b9469/0x8ebaae74e8215ae0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478357.471456:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e7a72481 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964360576:0@lo:101: 00000100:00100000:2.0:1789478357.471480:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478357.471510:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ee93588e going to sleep for 11 seconds 00000100:00100000:1.0:1789478357.472033:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964360576 00000100:00100000:1.0:1789478357.472039:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964360576 00000100:00100000:1.0:1789478357.472080:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789478357.472087:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052081121 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+15:6514:x1876403964360576:12345-0@lo:101: 00010000:00010000:1.0:1789478357.472096:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478357.472136:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fcdb16c5/0x8ebaae74e8215ae7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215ae0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478357.472154:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fcdb16c5/0x8ebaae74e8215ae7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215ae0 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478357.472163:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fcdb16c5/0x8ebaae74e8215ae7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215ae0 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478357.472169:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fcdb16c5, rc 0) 00000100:00100000:1.0:1789478357.472265:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052081121 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:6514:x1876403964360576:12345-0@lo:101: Request processed in 178us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478357.472271:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789478357.478197:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e7a72481 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964360576:0@lo:101: 00010000:00010000:3.0:1789478357.478225:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 000000000c4b9469/0x8ebaae74e8215ae0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215ae7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478357.478236:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 000000000c4b9469/0x8ebaae74e8215ae0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215ae7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478357.478319:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000065b365e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964360704:0@lo:501: 00000100:00100000:3.0:1789478357.478373:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478357.478475:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d834fdd2 going to sleep for 11 seconds 00000100:00100000:1.0:1789478357.488204:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964360704 00000100:00100000:1.0:1789478357.488228:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964360704 00000100:00100000:1.0:1789478357.488363:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789478357.488372:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000674c1ea6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:6514:x1876403964360704:12345-0@lo:501: 00000100:00100000:1.0:1789478357.488537:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000674c1ea6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:6514:x1876403964360704:12345-0@lo:501: Request processed in 166us (10164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478357.488544:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789478357.488636:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000065b365e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964360704:0@lo:501: 00000100:00100000:3.0:1789478357.488681:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000065b365e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964360832:0@lo:503: 00000100:00100000:3.0:1789478357.488754:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478357.496690:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964360832 00000100:00100000:0.0:1789478357.496705:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964360832 00000100:00100000:0.0:1789478357.496750:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789478357.496758:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055a55864 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:6514:x1876403964360832:12345-0@lo:503: 00000100:00100000:0.0:1789478357.496905:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055a55864 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:6514:x1876403964360832:12345-0@lo:503: Request processed in 148us (8165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478357.496922:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789478357.498279:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d834fdd2 going to sleep for 11 seconds 00000100:00100000:2.0:1789478357.498704:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000065b365e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964360832:0@lo:503: 00000100:00100000:0.0:1789478357.504336:0:7934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000023650e0f pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:7934:1876403964360960:0@lo:502: 00000100:00100000:0.0:1789478357.504417:0:7934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478357.504463:0:7934:0:(client.c:2715:ptlrpc_set_wait()) set 00000000003e9341 going to sleep for 11 seconds 00000100:00100000:1.0:1789478357.504531:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964360960 00000100:00100000:1.0:1789478357.504538:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964360960 00000100:00100000:1.0:1789478357.504588:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789478357.504642:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000822df1e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:7934:x1876403964360960:12345-0@lo:502: 00000100:00100000:1.0:1789478357.504753:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000822df1e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:7934:x1876403964360960:12345-0@lo:502: Request processed in 112us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478357.504760:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789478357.504991:0:7934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000023650e0f pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:7934:1876403964360960:0@lo:502: 00000020:01000000:0.0:1789478357.505017:0:7934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789478357.505024:0:7934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478357.505026:0:7934:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789478357.505033:0:7934:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ebc34d64800 00000020:00000080:0.0:1789478357.505035:0:7934:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789478357.505067:0:7934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:7934:1876403964361088:0@lo:502: 00000100:00100000:0.0:1789478357.505098:0:7934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478357.505136:0:7934:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08db30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478357.505196:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964361088 00000100:00100000:2.0:1789478357.505202:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964361088 00000100:00100000:2.0:1789478357.505236:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789478357.505244:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+16:7934:x1876403964361088:12345-0@lo:502: 00000100:00100000:2.0:1789478357.505321:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+16:7934:x1876403964361088:12345-0@lo:502: Request processed in 77us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478357.505328:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789478357.505501:0:7934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:7934:1876403964361088:0@lo:502: 00000020:01000000:0.0:1789478357.505519:0:7934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789478357.505523:0:7934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478357.505525:0:7934:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789478357.505528:0:7934:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1789478357.506314:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789478357.506338:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789478357.506348:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc00031200/0x8ebaae74e8215ae0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215ae7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478357.506359:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc00031200/0x8ebaae74e8215ae0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215ae7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478357.506383:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789478357.506385:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ebc0501d800 from 4 10000000:01000000:2.0:1789478357.506388:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789478357.506413:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215aee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478357.507233:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215aee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478357.507245:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215aee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478357.507263:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08884e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964361216:0@lo:101: 00000100:00100000:2.0:1789478357.507306:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478357.507343:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc0636de40 going to sleep for 11 seconds 00000100:00100000:0.0:1789478357.507852:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964361216 00000100:00100000:0.0:1789478357.507860:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964361216 00000100:00100000:0.0:1789478357.507911:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789478357.507919:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:6514:x1876403964361216:12345-0@lo:101: 00010000:00010000:0.0:1789478357.507930:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478357.507943:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc35b66400/0x8ebaae74e8215af5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215aee expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478357.507965:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc35b66400/0x8ebaae74e8215af5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215aee expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478357.507984:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc35b66400/0x8ebaae74e8215af5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215aee expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478357.507991:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b66400, rc 0) 00000100:00100000:0.0:1789478357.508042:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+17:6514:x1876403964361216:12345-0@lo:101: Request processed in 123us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478357.508048:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789478357.508198:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08884e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964361216:0@lo:101: 00010000:00010000:3.0:1789478357.508212:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215aee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215af5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478357.508221:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215aee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215af5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478357.508272:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09125500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964361344:0@lo:256: 00000100:00100000:3.0:1789478357.508303:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478357.508394:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08f58840 going to sleep for 11 seconds 00000100:00100000:1.0:1789478357.508728:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964361344 00000100:00100000:1.0:1789478357.508733:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964361344 00000100:00100000:1.0:1789478357.508766:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789478357.508909:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+17:6514:x1876403964361344:12345-0@lo:256: 20000000:01000000:1.0:1789478357.508926:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789478357.508942:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789478357.508945:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789478357.509026:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+17:6514:x1876403964361344:12345-0@lo:256: Request processed in 253us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478357.509032:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789478357.510000:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09125500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964361344:0@lo:256: 10000000:01000000:3.0:1789478357.510303:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789478357.510312:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215aee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215af5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478357.510322:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215aee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215af5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478357.510331:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789478357.510334:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebc0501d800 from 1 10000000:01000000:3.0:1789478357.510337:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789478357.510362:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed600/0x8ebaae74e8215afc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478357.510369:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed600/0x8ebaae74e8215afc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478357.510378:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed600/0x8ebaae74e8215afc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478357.510393:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09125500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964361472:0@lo:101: 00000100:00100000:3.0:1789478357.510563:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478357.510706:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964361472 00000100:00100000:1.0:1789478357.510713:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964361472 00000100:00100000:1.0:1789478357.510745:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789478357.510753:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+17:6514:x1876403964361472:12345-0@lo:101: 00010000:00010000:1.0:1789478357.510763:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1789478357.511409:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08f58840 going to sleep for 11 seconds 00010000:00010000:1.0:1789478357.512246:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc029de200/0x8ebaae74e8215b03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215afc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478357.512382:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc029de200/0x8ebaae74e8215b03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215afc expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478357.512395:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc029de200/0x8ebaae74e8215b03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215afc expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478357.512403:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029de200, rc 0) 00000100:00100000:0.0:1789478357.514555:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964361472:12345-0@lo:101: Request processed in 3795us (3986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478357.514567:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789478357.514782:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09125500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964361472:0@lo:101: 00010000:00010000:2.0:1789478357.514804:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed600/0x8ebaae74e8215afc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215b03 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478357.514815:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed600/0x8ebaae74e8215afc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215b03 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478357.515432:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08886680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964361600:0@lo:501: 00000100:00100000:2.0:1789478357.515994:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478357.516100:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc0636de40 going to sleep for 11 seconds 00000100:00100000:0.0:1789478357.516520:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964361600 00000100:00100000:0.0:1789478357.516528:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964361600 00000100:00100000:0.0:1789478357.516575:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789478357.516584:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964361600:12345-0@lo:501: 00000100:00100000:0.0:1789478357.517109:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964361600:12345-0@lo:501: Request processed in 524us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478357.517117:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789478357.517190:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08886680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964361600:0@lo:501: 00000100:00100000:2.0:1789478357.517226:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08886680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964361728:0@lo:503: 00000100:00100000:2.0:1789478357.517276:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478357.517335:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc0636de40 going to sleep for 11 seconds 00000100:00100000:0.0:1789478357.517371:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964361728 00000100:00100000:0.0:1789478357.517376:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964361728 00000100:00100000:0.0:1789478357.517445:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789478357.517452:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964361728:12345-0@lo:503: 00000100:00100000:0.0:1789478357.517541:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964361728:12345-0@lo:503: Request processed in 89us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478357.517547:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789478357.517660:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08886680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964361728:0@lo:503: 00000100:00100000:3.0:1789478357.517858:0:7935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09127b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:7935:1876403964361856:0@lo:502: 00000100:00100000:3.0:1789478357.517896:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478357.518613:0:7935:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08f58000 going to sleep for 11 seconds 00000100:00100000:2.0:1789478357.519003:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964361856 00000100:00100000:2.0:1789478357.519010:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964361856 00000100:00100000:2.0:1789478357.519043:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789478357.519052:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+18:7935:x1876403964361856:12345-0@lo:502: 00000100:00100000:2.0:1789478357.519164:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+18:7935:x1876403964361856:12345-0@lo:502: Request processed in 112us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478357.519171:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789478357.521232:0:7935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09127b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:7935:1876403964361856:0@lo:502: 00000020:01000000:3.0:1789478357.521532:0:7935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789478357.521544:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478357.521555:0:7935:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789478357.521563:0:7935:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ebc0501d800 00000020:00000080:3.0:1789478357.521566:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789478357.522319:0:7935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09127b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:7935:1876403964361984:0@lo:502: 00000100:00100000:2.0:1789478357.522516:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478357.522558:0:7935:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05297f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789478357.523549:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964361984 00000100:00100000:0.0:1789478357.523560:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964361984 00000100:00100000:0.0:1789478357.523655:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789478357.523665:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+18:7935:x1876403964361984:12345-0@lo:502: 00000100:00100000:0.0:1789478357.523794:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+18:7935:x1876403964361984:12345-0@lo:502: Request processed in 131us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478357.523812:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789478357.524160:0:7935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09127b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:7935:1876403964361984:0@lo:502: 00000020:01000000:3.0:1789478357.524187:0:7935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789478357.524193:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478357.524195:0:7935:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789478357.524199:0:7935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789478357.524989:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789478357.525012:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789478357.525021:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed600/0x8ebaae74e8215afc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215b03 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478357.525034:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed600/0x8ebaae74e8215afc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215b03 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478357.541938:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478358.569383:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478358.756840:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876403964362240:0@lo:400: 00000100:00100000:2.0:1789478358.756902:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478358.756941:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789478358.756948:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964362112:0@lo:400: 00000100:00100000:2.0:1789478358.756975:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478358.756997:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876403964362624:0@lo:400: 00000100:00100000:2.0:1789478358.757017:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478358.757041:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964362368:0@lo:400: 00000100:00100000:2.0:1789478358.757064:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478358.757081:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789478358.757086:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964362496:0@lo:400: 00000100:00100000:2.0:1789478358.757106:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478358.757145:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964362368 00000100:00100000:2.0:1789478358.757152:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964362368 00000100:00100000:3.0:1789478358.757185:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964362240 00000100:00100000:2.0:1789478358.757305:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964362496 00000100:00100000:2.0:1789478358.757309:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964362496 00000100:00100000:2.0:1789478358.757344:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789478358.757352:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964362368:12345-0@lo:400: 00000100:00100000:2.0:1789478358.757403:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964362368:12345-0@lo:400: Request processed in 52us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478358.757410:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789478358.757438:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789478358.757449:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964362240 00000100:00100000:2.0:1789478358.757456:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964362496:12345-0@lo:400: 00000100:00100000:3.0:1789478358.757492:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964362624 00000100:00100000:3.0:1789478358.757496:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964362624 00000100:00100000:3.0:1789478358.757510:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789478358.757517:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876403964362240:12345-0@lo:400: 00000100:00100000:3.0:1789478358.757559:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876403964362240:12345-0@lo:400: Request processed in 43us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478358.757566:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789478358.757579:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789478358.757585:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876403964362624:12345-0@lo:400: 00000100:00100000:3.0:1789478358.757634:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876403964362624:12345-0@lo:400: Request processed in 50us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478358.757640:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789478358.757680:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ebc08886680 x1876403964362624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478358.757694:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876403964362624:0@lo:400: 00010000:00080000:3.0:1789478358.757709:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ebc08887800 x1876403964362240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478358.757724:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964362368:0@lo:400: 00000100:00100000:3.0:1789478358.757729:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876403964362240:0@lo:400: 00000100:00100000:1.0:1789478358.758036:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789478358.758047:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964362752:0@lo:41: 00000100:00100000:1.0:1789478358.758079:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478358.758114:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964362112 00000100:00100000:1.0:1789478358.758132:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964362112 00000100:00100000:1.0:1789478358.758163:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789478358.758170:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+18:3646:x1876403964362112:12345-0@lo:400: 00000100:00100000:1.0:1789478358.758203:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+18:3646:x1876403964362112:12345-0@lo:400: Request processed in 34us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478358.758210:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789478358.758379:0:6522:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1789478358.758387:0:6522:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1789478358.758421:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964362112:0@lo:400: 00000100:00100000:0.0:1789478358.758622:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789478358.758630:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964362880:0@lo:41: 00000100:00100000:0.0:1789478358.758661:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478358.759200:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964362496:12345-0@lo:400: Request processed in 1744us (2090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478358.759208:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789478358.759232:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964362752 00000100:00100000:0.0:1789478358.759236:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964362752 00000100:00100000:0.0:1789478358.759251:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964362880 00000100:00100000:0.0:1789478358.759253:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964362880 00000100:00100000:0.0:1789478358.759275:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789478358.759281:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964362752:12345-0@lo:41: 00000004:00000024:0.0:1789478358.759304:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1789478358.759343:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964362752:12345-0@lo:41: Request processed in 62us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478358.759349:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789478358.759361:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789478358.759367:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964362880:12345-0@lo:41: 00000004:00000024:0.0:1789478358.759380:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789478358.759406:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964362880:12345-0@lo:41: Request processed in 40us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478358.759425:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789478358.759453:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964362880:0@lo:41: 00000100:00100000:2.0:1789478358.759899:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964362752:0@lo:41: 00000100:00100000:1.0:1789478358.760039:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964362496:0@lo:400: 00010000:00010000:0.0:1789478359.588785:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478360.613850:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478361.637768:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478362.662156:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478363.684806:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478363.880428:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964363008:0@lo:41: 00000100:00100000:2.0:1789478363.880495:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478363.880583:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964363008 00000100:00100000:1.0:1789478363.880590:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964363008 00000100:00100000:1.0:1789478363.880642:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789478363.880650:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964363008:12345-0@lo:41: 00000100:00100000:2.0:1789478363.880665:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964363136:0@lo:41: 00000004:00000024:1.0:1789478363.880678:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789478363.880689:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478363.880713:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964363648:0@lo:400: 00000100:00100000:1.0:1789478363.880713:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964363008:12345-0@lo:41: Request processed in 63us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478363.880719:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789478363.880734:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478363.880734:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964363136 00000100:00100000:1.0:1789478363.880737:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964363136 00000100:00100000:2.0:1789478363.880749:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789478363.880751:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789478363.880754:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964363264:0@lo:400: 00000100:00100000:1.0:1789478363.880756:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964363136:12345-0@lo:41: 00000004:00000024:1.0:1789478363.880770:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1789478363.880776:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478363.880796:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964363136:12345-0@lo:41: Request processed in 40us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478363.880802:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789478363.880809:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964363136:0@lo:41: 00000100:00100000:2.0:1789478363.880831:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964363264 00000100:00100000:2.0:1789478363.880834:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964363264 00000100:00100000:2.0:1789478363.880870:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789478363.880876:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+18:3645:x1876403964363264:12345-0@lo:400: 00000100:00100000:2.0:1789478363.880909:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+18:3645:x1876403964363264:12345-0@lo:400: Request processed in 33us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478363.880915:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789478363.880950:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964363520:0@lo:400: 00000100:00100000:2.0:1789478363.880970:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478363.881003:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964363008:0@lo:41: 00000100:00100000:2.0:1789478363.881016:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789478363.881020:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876403964363392:0@lo:400: 00000100:00100000:2.0:1789478363.881039:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478363.881064:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964363264:0@lo:400: 00000100:00100000:1.0:1789478363.881127:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964363520 00000100:00100000:1.0:1789478363.881131:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964363520 00000100:00100000:1.0:1789478363.881149:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789478363.881154:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964363520:12345-0@lo:400: 00000100:00100000:1.0:1789478363.881260:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964363520:12345-0@lo:400: Request processed in 104us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478363.881280:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789478363.881308:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964363648 00000100:00100000:3.0:1789478363.881312:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964363648 00000100:00100000:3.0:1789478363.881349:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964363392 00000100:00100000:3.0:1789478363.881352:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964363392 00000100:00100000:3.0:1789478363.881367:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789478363.881374:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964363648:12345-0@lo:400: 00000100:00100000:3.0:1789478363.881410:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964363648:12345-0@lo:400: Request processed in 37us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478363.881416:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789478363.881427:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789478363.881433:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876403964363392:12345-0@lo:400: 00000100:00100000:3.0:1789478363.881455:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876403964363392:12345-0@lo:400: Request processed in 23us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478363.881460:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789478363.881486:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ebc40ecd180 x1876403964363648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478363.881509:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964363648:0@lo:400: 00000100:00100000:2.0:1789478363.884375:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964363520:0@lo:400: 00010000:00080000:2.0:1789478363.885480:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ebc08886680 x1876403964363392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478363.885493:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876403964363392:0@lo:400: 00010000:00010000:1.0:1789478364.710783:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789478365.358112:0:8423:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789478365.358115:0:8423:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789478365.358117:0:8423:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789478365.358288:0:8423:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ebc40e0d800 00000020:01000004:2.0:1789478365.358302:0:8423:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789478365.358313:0:8423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789478365.358333:0:8423:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8ebc27158000) 00000020:00000080:2.0:1789478365.358349:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789478365.388083:0:8423:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789478365.388165:0:8423:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1789478365.402273:0:8423:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789478365.402490:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789478365.402501:0:8423:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789478365.402512:0:8423:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8ebaae74e8215b11 00000020:01000004:2.0:1789478365.402517:0:8423:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789478365.402537:0:8423:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.111@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789478365.402540:0:8423:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789478365.402774:0:8423:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789478365.402780:0:8423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789478365.402791:0:8423:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8ebc271599b8) 00000020:00000080:2.0:1789478365.402801:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1789478365.404018:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789478365.404167:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789478365.404173:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789478365.406623:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789478365.406634:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789478365.407034:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789478365.407041:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789478365.408379:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789478365.408545:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789478365.408550:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789478365.411242:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789478365.411253:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789478365.422895:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789478365.423133:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789478365.423140:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789478365.424413:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789478365.424423:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789478365.425500:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789478365.425510:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789478365.429991:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789478365.430253:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789478365.430259:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789478365.430806:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789478365.430813:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789478365.453784:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789478365.453970:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789478365.453977:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789478365.464508:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789478365.464644:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789478365.465230:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789478365.465256:0:8423:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1789478365.465261:0:8423:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.111@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789478365.483255:0:8423:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789478365.483287:0:8423:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.111@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1789478365.483291:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789478365.483292:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789478365.483294:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789478365.483295:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789478365.483296:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789478365.483297:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789478365.483299:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789478365.483300:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789478365.483302:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789478365.483303:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789478365.483305:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789478365.483308:0:8423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1789478365.483311:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789478365.483312:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789478365.483313:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789478365.483314:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789478365.483315:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789478365.483316:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789478365.483317:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789478365.483318:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789478365.483319:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789478365.483320:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789478365.483321:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789478365.483352:0:8423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789478365.483370:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34c99f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964363776:0@lo:253: 00000100:00100000:1.0:1789478365.483432:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478365.483481:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08db3540 going to sleep for 11 seconds 00000100:00100000:0.0:1789478365.483786:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964363776 00000100:00100000:0.0:1789478365.483793:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964363776 00000100:00100000:0.0:1789478365.483895:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789478365.483906:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+18:8423:x1876403964363776:12345-0@lo:253: 20000000:01000000:0.0:1789478365.483964:0:6512:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789478365.483969:0:6512:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1789478365.483974:0:6512:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1789478365.483978:0:6512:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1789478365.484187:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789478365.484308:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1789478365.484324:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1789478365.484341:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1789478365.484347:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1789478365.484361:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1789478365.484377:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1789478365.484459:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1789478365.484473:0:6512:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.111@tcp 20000000:01000000:0.0:1789478365.484475:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.111@tcp (null) (null) (null) 00000040:00080000:0.0:1789478365.484489:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1789478365.484495:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789478365.484508:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1789478365.484513:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.111@tcp (null) (null) 00000040:00080000:0.0:1789478365.484526:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1789478365.484532:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789478365.484544:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1789478365.484560:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1789478365.485292:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1789478365.485309:0:6512:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.111@tcp 20000000:01000000:0.0:1789478365.485311:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.111@tcp (null) (null) (null) 00000040:00080000:0.0:1789478365.485326:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1789478365.485331:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789478365.485345:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1789478365.485356:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.206.111@tcp (null) (null) 00000040:00080000:0.0:1789478365.485373:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1789478365.485394:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789478365.485414:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1789478365.485428:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1789478365.485822:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1789478365.485834:0:6512:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.111@tcp 20000000:01000000:0.0:1789478365.485836:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.111@tcp (null) (null) (null) 00000040:00080000:0.0:1789478365.485850:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1789478365.485854:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789478365.485867:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1789478365.485872:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.111@tcp (null) (null) 00000040:00080000:0.0:1789478365.485884:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1789478365.485890:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789478365.485903:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1789478365.485918:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1789478365.485931:0:6512:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789478365.485934:0:6512:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789478365.485937:0:6512:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789478365.486004:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789478365.486007:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789478365.486933:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1789478365.487022:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1789478365.487040:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1789478365.487249:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1789478365.487268:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1789478365.487281:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:0.0:1789478365.487290:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789478365.487292:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789478365.487546:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1789478365.487821:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1789478365.487842:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1789478365.487857:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1789478365.487867:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789478365.487869:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789478365.488564:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1789478365.488589:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1789478365.488669:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1789478365.488806:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1789478365.488867:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1789478365.488888:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1789478365.488898:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789478365.488906:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789478365.489311:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1789478365.489331:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1789478365.489347:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789478365.489485:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789478365.489506:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789478365.489532:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:1.0:1789478365.489546:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789478365.489563:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ebc029df800/0x8ebaae74e8215b1f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.489581:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc42177800/0x8ebaae74e82159eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e82159e4 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.489588:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc00030a00/0x8ebaae74e8215a2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215a23 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.489638:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc029de600/0x8ebaae74e8215a46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215a3f expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.489645:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc35b67000/0x8ebaae74e8215a93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215a85 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.489652:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc35b66200/0x8ebaae74e8215aa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215a9a expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.489660:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ebc029df800/0x8ebaae74e8215b1f lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.489696:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc35b66200/0x8ebaae74e8215aa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215a9a expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.489709:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc35b66200/0x8ebaae74e8215aa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215a9a expref: 18 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478365.489721:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34c99500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6512:1876403964363904:0@lo:104: 00000100:00100000:1.0:1789478365.489799:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789478365.489855:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc35b67000/0x8ebaae74e8215a93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215a85 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.489864:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc35b67000/0x8ebaae74e8215a93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215a85 expref: 18 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478365.489873:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34c98000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6512:1876403964364032:0@lo:104: 00000100:00100000:1.0:1789478365.489906:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789478365.489940:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc029de600/0x8ebaae74e8215a46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215a3f expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478365.490144:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964363904 00000100:00100000:2.0:1789478365.490152:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964363904 00000100:00100000:2.0:1789478365.490184:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964364032 00000100:00100000:2.0:1789478365.490187:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964364032 00000100:00100000:2.0:1789478365.490202:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789478365.490213:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+4:6512:x1876403964363904:12345-0@lo:104: 00010000:00010000:2.0:1789478365.490225:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67e00/0x8ebaae74e8215a9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215aa1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.490319:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc029de600/0x8ebaae74e8215a46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215a3f expref: 18 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478365.490331:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b70a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6512:1876403964364160:0@lo:104: 00000100:00100000:1.0:1789478365.490353:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789478365.490372:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc00030a00/0x8ebaae74e8215a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215a23 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.490380:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc00030a00/0x8ebaae74e8215a2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215a23 expref: 18 pid: 6512 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478365.490388:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b72680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6512:1876403964364288:0@lo:104: 00000100:00100000:1.0:1789478365.490407:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789478365.490422:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc42177800/0x8ebaae74e82159eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e82159e4 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.490429:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc42177800/0x8ebaae74e82159eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e82159e4 expref: 18 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478365.490438:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b73b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6512:1876403964364416:0@lo:104: 00000100:00100000:1.0:1789478365.490464:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478365.490475:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08db3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789478365.490492:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34c99500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6512:1876403964363904:0@lo:104: 00010000:00010000:2.0:1789478365.490535:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789478365.490541:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+4:6512:x1876403964363904:12345-0@lo:104: Request processed in 331us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478365.490548:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789478365.490563:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964364160 00000100:00100000:2.0:1789478365.490566:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964364160 00000100:00100000:2.0:1789478365.490578:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964364288 00000100:00100000:2.0:1789478365.490580:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964364288 00000100:00100000:2.0:1789478365.490633:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964364416 00000100:00100000:2.0:1789478365.490637:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964364416 00000100:00100000:2.0:1789478365.490649:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789478365.490655:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+6:6512:x1876403964364032:12345-0@lo:104: 00010000:00010000:2.0:1789478365.490663:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc029df400/0x8ebaae74e8215a85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215a93 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478365.490756:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34c98000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6512:1876403964364032:0@lo:104: 00010000:00010000:0.0:1789478365.490913:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789478365.490920:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67e00/0x8ebaae74e8215a9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215aa1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.490928:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67e00 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478365.490932:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67e00/0x8ebaae74e8215a9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215aa1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.490941:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67e00/0x8ebaae74e8215a9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215aa1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478365.490947:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67e00/0x8ebaae74e8215a9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215aa1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.491054:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789478365.491061:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+6:6512:x1876403964364032:12345-0@lo:104: Request processed in 406us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478365.491067:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789478365.491083:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789478365.491101:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+5:6512:x1876403964364160:12345-0@lo:104: 00010000:00010000:2.0:1789478365.491108:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215a3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215a46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478365.491194:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789478365.491222:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67e00/0x8ebaae74e8215a9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215aa1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.491229:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478365.491249:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67e00/0x8ebaae74e8215a9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215aa1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.491256:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67e00/0x8ebaae74e8215a9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215aa1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.491266:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789478365.491270:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc029df400/0x8ebaae74e8215a85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215a93 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.491281:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029df400 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478365.491284:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc029df400/0x8ebaae74e8215a85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215a93 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.491290:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc029df400/0x8ebaae74e8215a85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215a93 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478365.491296:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc029df400/0x8ebaae74e8215a85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215a93 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478365.491301:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789478365.491314:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc029df400/0x8ebaae74e8215a85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215a93 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.491320:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478365.491335:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc029df400/0x8ebaae74e8215a85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215a93 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.491347:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc029df400/0x8ebaae74e8215a85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215a93 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.491355:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789478365.491358:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215a3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215a46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.491364:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc00030c00 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478365.491367:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215a3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215a46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.491384:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215a3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215a46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.491389:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1789478365.491390:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215a3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215a46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478365.491395:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789478365.491408:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215a3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215a46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.491414:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478365.491419:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215a3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215a46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.491425:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215a3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215a46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.491439:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478365.491441:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478365.491443:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478365.491457:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b70a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6512:1876403964364160:0@lo:104: 00000100:00100000:3.0:1789478365.491470:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964364544:0@lo:103: 00010000:00010000:2.0:1789478365.491486:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789478365.491492:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+5:6512:x1876403964364160:12345-0@lo:104: Request processed in 393us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478365.491498:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789478365.491512:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789478365.491518:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+4:6512:x1876403964364288:12345-0@lo:104: 00010000:00010000:2.0:1789478365.491526:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc42176000/0x8ebaae74e8215a23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215a2a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.491612:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789478365.491618:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+4:6512:x1876403964364288:12345-0@lo:104: Request processed in 100us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478365.491624:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789478365.491637:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789478365.491644:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+3:6512:x1876403964364416:12345-0@lo:104: 00010000:00010000:2.0:1789478365.491651:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc421edc00/0x8ebaae74e82159e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e82159eb expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478365.491665:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478365.491712:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964364672:0@lo:103: 00000100:00100000:1.0:1789478365.491723:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964364544 00000100:00100000:1.0:1789478365.491727:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964364544 00000100:00100000:3.0:1789478365.491734:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478365.491750:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1789478365.491759:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc35b66200/0x8ebaae74e8215aa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215a9a expref: 19 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478365.491778:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964364672 00000100:00100000:1.0:1789478365.491781:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964364672 00010000:00010000:1.0:1789478365.491792:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc35b67000/0x8ebaae74e8215a93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215a85 expref: 20 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478365.491804:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789478365.491810:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09127b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+20:3646:x1876403964364544:12345-0@lo:103: 00010000:00010000:1.0:1789478365.491820:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478365.491825:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc35b66200/0x8ebaae74e8215aa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215a9a expref: 20 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.491835:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc35b66200/0x8ebaae74e8215aa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215a9a expref: 20 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.491848:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc35b66200/0x8ebaae74e8215aa1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215a9a expref: 20 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.491859:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478365.491886:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09127b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+19:3646:x1876403964364544:12345-0@lo:103: Request processed in 76us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478365.491902:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789478365.491916:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789478365.491922:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09124000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+18:3647:x1876403964364672:12345-0@lo:103: 00010000:00010000:1.0:1789478365.491929:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789478365.491932:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964364800:0@lo:103: 00010000:00010000:1.0:1789478365.491933:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc35b67000/0x8ebaae74e8215a93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215a85 expref: 18 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.491942:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc35b67000/0x8ebaae74e8215a93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215a85 expref: 18 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478365.491955:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789478365.491964:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc35b67000/0x8ebaae74e8215a93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215a85 expref: 18 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.491971:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478365.491975:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789478365.491981:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1789478365.491995:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09124000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+17:3647:x1876403964364672:12345-0@lo:103: Request processed in 74us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478365.492001:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789478365.492011:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964364800 00000100:00100000:1.0:1789478365.492014:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964364800 00000100:00100000:3.0:1789478365.492015:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b72680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6512:1876403964364288:0@lo:104: 00000100:00100000:3.0:1789478365.492023:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b73b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6512:1876403964364416:0@lo:104: 00010000:00010000:1.0:1789478365.492024:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc029de600/0x8ebaae74e8215a46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215a3f expref: 17 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478365.492034:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789478365.492039:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09124380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+17:3647:x1876403964364800:12345-0@lo:103: 00010000:00010000:1.0:1789478365.492045:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478365.492047:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ebc029df800/0x8ebaae74e8215b1f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.492049:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc029de600/0x8ebaae74e8215a46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215a3f expref: 17 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.492057:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc029de600/0x8ebaae74e8215a46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215a3f expref: 17 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.492079:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc029de600/0x8ebaae74e8215a46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215a3f expref: 17 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.492098:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478365.492125:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09124380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+16:3647:x1876403964364800:12345-0@lo:103: Request processed in 85us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478365.492131:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1789478365.492134:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789478365.492139:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc42176000/0x8ebaae74e8215a23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215a2a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.492146:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc42176000 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478365.492149:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc42176000/0x8ebaae74e8215a23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215a2a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478365.492154:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964364544:0@lo:103: 00010000:00010000:0.0:1789478365.492156:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc42176000/0x8ebaae74e8215a23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215a2a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.492167:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:0.0:1789478365.492174:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc42176000/0x8ebaae74e8215a23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215a2a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478365.492178:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964364800:0@lo:103: 00000100:00100000:1.0:1789478365.492185:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964364672:0@lo:103: 10000000:01000000:0.0:1789478365.492246:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789478365.492275:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc42176000/0x8ebaae74e8215a23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215a2a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.492281:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478365.492298:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc42176000/0x8ebaae74e8215a23 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215a2a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.492305:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc42176000/0x8ebaae74e8215a23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215a2a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.492316:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478365.492318:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478365.492320:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478365.492337:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789478365.492347:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964364928:0@lo:103: 00000100:00100000:1.0:1789478365.492370:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478365.492390:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964364928 00000100:00100000:1.0:1789478365.492394:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964364928 00010000:00010000:1.0:1789478365.492407:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc00030a00/0x8ebaae74e8215a2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215a23 expref: 16 pid: 6512 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478365.492421:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789478365.492427:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+16:3646:x1876403964364928:12345-0@lo:103: 00010000:00010000:1.0:1789478365.492434:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478365.492438:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc00030a00/0x8ebaae74e8215a2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215a23 expref: 16 pid: 6512 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.492446:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc00030a00/0x8ebaae74e8215a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215a23 expref: 16 pid: 6512 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.492461:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc00030a00/0x8ebaae74e8215a2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215a23 expref: 16 pid: 6512 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.492468:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478365.492494:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+15:3646:x1876403964364928:12345-0@lo:103: Request processed in 67us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478365.492500:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789478365.492568:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789478365.492575:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+3:6512:x1876403964364416:12345-0@lo:104: Request processed in 932us (2110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478365.492581:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789478365.492929:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964364928:0@lo:103: 00010000:00010000:1.0:1789478365.493021:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478365.493156:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478365.493163:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478365.493165:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478365.493207:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc421edc00/0x8ebaae74e82159e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e82159eb expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.493215:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc421edc00 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478365.493218:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc421edc00/0x8ebaae74e82159e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e82159eb expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.493226:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc421edc00/0x8ebaae74e82159e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e82159eb expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478365.493233:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc421edc00/0x8ebaae74e82159e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e82159eb expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478365.493244:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789478365.493268:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc421edc00/0x8ebaae74e82159e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e82159eb expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.493275:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789478365.493294:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964365056:0@lo:103: 00010000:00010000:0.0:1789478365.493294:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc421edc00/0x8ebaae74e82159e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e82159eb expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.493301:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc421edc00/0x8ebaae74e82159e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e82159eb expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.493312:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478365.493314:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478365.493316:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478365.493380:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478365.493445:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964365056 00000100:00100000:2.0:1789478365.493449:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964365056 00010000:00010000:2.0:1789478365.493462:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc42177800/0x8ebaae74e82159eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e82159e4 expref: 15 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478365.493507:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789478365.493514:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08c60c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+15:3646:x1876403964365056:12345-0@lo:103: 00010000:00010000:2.0:1789478365.493521:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478365.493525:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc42177800/0x8ebaae74e82159eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e82159e4 expref: 15 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.493535:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc42177800/0x8ebaae74e82159eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e82159e4 expref: 15 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.493545:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc42177800/0x8ebaae74e82159eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e82159e4 expref: 15 pid: 6511 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.493556:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ebc029df800/0x8ebaae74e8215b1f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.493563:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc029df800/0x8ebaae74e8215b1f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.493576:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc029df800/0x8ebaae74e8215b1f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.493624:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc029df800/0x8ebaae74e8215b1f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.493633:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ebc029df800/0x8ebaae74e8215b1f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.493639:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ebc029df800/0x8ebaae74e8215b1f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.493649:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029df800 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478365.493653:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ebc029df800/0x8ebaae74e8215b1f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.493660:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ebc029df800/0x8ebaae74e8215b1f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.493674:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ebc029df800/0x8ebaae74e8215b1f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.493683:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478365.493712:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08c60c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+14:3646:x1876403964365056:12345-0@lo:103: Request processed in 199us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478365.493719:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789478365.493871:0:6512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ebc029df800/0x8ebaae74e8215b1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478365.493880:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ebc029df800/0x8ebaae74e8215b1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478365.493886:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc029df800/0x8ebaae74e8215b1f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789478365.493898:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789478365.494075:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964365056:0@lo:103: 00000100:00100000:3.0:1789478365.496444:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+13:8423:x1876403964363776:12345-0@lo:253: Request processed in 12534us (13004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478365.496455:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789478365.496546:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34c99f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964363776:0@lo:253: 10000000:01000000:2.0:1789478365.496559:0:8423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789478365.496563:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789478365.496564:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789478365.496565:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478365.496567:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789478365.496568:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478365.496579:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478365.496580:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789478365.496582:0:8423:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789478365.496583:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478365.496584:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789478365.496730:0:8423:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ebc40e0d800 from lustre-OST0000 10000000:01000000:2.0:1789478365.496835:0:8423:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789478365.496839:0:8423:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789478365.496846:0:8423:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ebc08d93370 local copy 10000000:01000000:2.0:1789478365.496850:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789478365.496882:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215b26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.496893:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215b26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.496903:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215b26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478365.496919:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964365184:0@lo:101: 00000100:00100000:2.0:1789478365.497036:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478365.497119:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34eadd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789478365.497258:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964365184 00000100:00100000:3.0:1789478365.497264:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964365184 00000100:00100000:3.0:1789478365.497333:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789478365.497341:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+13:8423:x1876403964365184:12345-0@lo:101: 00010000:00010000:3.0:1789478365.497352:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478365.497364:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc421ed000/0x8ebaae74e8215b2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215b26 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478365.497385:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc421ed000/0x8ebaae74e8215b2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215b26 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478365.497403:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc421ed000/0x8ebaae74e8215b2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215b26 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478365.497412:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc421ed000, rc 0) 00000100:00100000:3.0:1789478365.497452:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+14:8423:x1876403964365184:12345-0@lo:101: Request processed in 112us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478365.497458:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789478365.497518:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964365184:0@lo:101: 00010000:00010000:2.0:1789478365.497529:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215b26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8ebaae74e8215b2d expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.497538:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215b26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8ebaae74e8215b2d expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478365.497644:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964365312:0@lo:501: 00000100:00100000:2.0:1789478365.497669:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478365.498009:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34eadd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789478365.498066:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964365312 00000100:00100000:1.0:1789478365.498071:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964365312 00000100:00100000:0.0:1789478365.498339:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789478365.498348:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+14:8423:x1876403964365312:12345-0@lo:501: 00000100:00100000:0.0:1789478365.498419:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+14:8423:x1876403964365312:12345-0@lo:501: Request processed in 72us (749us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789478365.498426:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789478365.498480:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964365312:0@lo:501: 10000000:01000000:1.0:1789478365.498493:0:8423:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789478365.498516:0:8423:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789478365.498521:0:8423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215b26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8ebaae74e8215b2d expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.498530:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215b26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8ebaae74e8215b2d expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.498536:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215b26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8ebaae74e8215b2d expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.498552:0:8423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789478365.498575:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ebc40e0d800 00010000:00010000:1.0:1789478365.498619:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789478365.498625:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215b26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8ebaae74e8215b2d expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.498632:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc00031800 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:1.0:1789478365.498636:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215b26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8ebaae74e8215b2d expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.498644:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215b26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x8ebaae74e8215b2d expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478365.498652:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215b26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x8ebaae74e8215b2d expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478365.498658:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789478365.498676:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215b26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8ebaae74e8215b2d expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.498682:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789478365.498697:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215b26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8ebaae74e8215b2d expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.498703:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215b26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8ebaae74e8215b2d expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.498716:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478365.498718:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478365.498720:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478365.498726:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789478365.498747:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964365440:0@lo:103: 00000100:00100000:1.0:1789478365.498775:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478365.498817:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964365440 00000100:00100000:1.0:1789478365.498821:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964365440 00000100:00100000:1.0:1789478365.498853:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789478365.498860:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+14:3648:x1876403964365440:12345-0@lo:103: 00010000:00010000:1.0:1789478365.498869:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478365.498880:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc421ed000/0x8ebaae74e8215b2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ebaae74e8215b26 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.498890:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478365.498916:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+13:3648:x1876403964365440:12345-0@lo:103: Request processed in 57us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478365.498922:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789478365.499133:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964365440:0@lo:103: 10000000:01000000:1.0:1789478365.499154:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789478365.499160:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789478365.499163:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789478365.499168:0:8423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789478365.499171:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789478365.499189:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc029de600/0x8ebaae74e8215b34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.499196:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc029de600/0x8ebaae74e8215b34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.499204:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc029de600/0x8ebaae74e8215b34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478365.499216:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964365568:0@lo:101: 00000100:00100000:1.0:1789478365.499242:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478365.500040:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08db3540 going to sleep for 11 seconds 00000100:00100000:2.0:1789478365.500112:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964365568 00000100:00100000:2.0:1789478365.500119:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964365568 00000100:00100000:2.0:1789478365.500149:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789478365.500156:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+13:8423:x1876403964365568:12345-0@lo:101: 00010000:00010000:2.0:1789478365.500166:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478365.500179:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc00030c00/0x8ebaae74e8215b3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215b34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.500196:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc00030c00/0x8ebaae74e8215b3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215b34 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.500205:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc00030c00/0x8ebaae74e8215b3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215b34 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.500211:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc00030c00, rc 0) 00000100:00100000:2.0:1789478365.500254:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+14:8423:x1876403964365568:12345-0@lo:101: Request processed in 99us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478365.500260:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789478365.500326:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964365568:0@lo:101: 00010000:00010000:1.0:1789478365.500337:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc029de600/0x8ebaae74e8215b34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215b3b expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.500346:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc029de600/0x8ebaae74e8215b34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215b3b expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478365.500424:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964365696:0@lo:501: 00000100:00100000:1.0:1789478365.500451:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478365.500471:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08db3540 going to sleep for 11 seconds 00000100:00100000:2.0:1789478365.500514:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964365696 00000100:00100000:2.0:1789478365.500518:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964365696 00000100:00100000:2.0:1789478365.500535:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789478365.500541:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+14:8423:x1876403964365696:12345-0@lo:501: 00000100:00100000:2.0:1789478365.500671:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+14:8423:x1876403964365696:12345-0@lo:501: Request processed in 130us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478365.500678:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789478365.500866:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964365696:0@lo:501: 00000100:00100000:1.0:1789478365.500892:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964365824:0@lo:503: 00000100:00100000:1.0:1789478365.500933:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478365.500964:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08db3540 going to sleep for 11 seconds 00000100:00100000:2.0:1789478365.501066:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964365824 00000100:00100000:2.0:1789478365.501071:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964365824 00000100:00100000:2.0:1789478365.501102:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789478365.501116:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+14:8423:x1876403964365824:12345-0@lo:503: 00000100:00100000:2.0:1789478365.501202:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+14:8423:x1876403964365824:12345-0@lo:503: Request processed in 86us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478365.501209:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789478365.501279:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964365824:0@lo:503: 00000040:00080000:1.0:1789478365.501509:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789478365.501573:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964365952:0@lo:502: 00000100:00100000:1.0:1789478365.501710:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478365.501728:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08db3540 going to sleep for 11 seconds 00000100:00100000:2.0:1789478365.501840:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964365952 00000100:00100000:2.0:1789478365.501845:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964365952 00000100:00100000:2.0:1789478365.501866:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789478365.501873:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+14:8423:x1876403964365952:12345-0@lo:502: 00000100:00100000:2.0:1789478365.501979:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+14:8423:x1876403964365952:12345-0@lo:502: Request processed in 106us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478365.501986:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789478365.502124:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964365952:0@lo:502: 00000040:00080000:1.0:1789478365.502307:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789478365.502332:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789478365.502347:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789478365.502359:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789478365.502383:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789478365.502399:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789478365.502424:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964366080:0@lo:502: 00000100:00100000:1.0:1789478365.502457:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478365.502477:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08db3540 going to sleep for 11 seconds 00000100:00100000:0.0:1789478365.503180:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964366080 00000100:00100000:0.0:1789478365.503187:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964366080 00000100:00100000:0.0:1789478365.503220:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789478365.503227:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+14:8423:x1876403964366080:12345-0@lo:502: 00000100:00100000:0.0:1789478365.503358:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+14:8423:x1876403964366080:12345-0@lo:502: Request processed in 131us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478365.503365:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789478365.503893:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964366080:0@lo:502: 00000040:00080000:1.0:1789478365.504025:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789478365.504036:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1789478365.504463:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789478365.504471:0:8448:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1789478365.504486:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478365.504488:0:8448:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789478365.504495:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789478365.504509:0:8448:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8ebc091a0000) 00000020:00000080:3.0:1789478365.506688:0:8448:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789478365.506713:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789478365.506822:0:8448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ebc40e0d800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789478365.506833:0:8448:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789478365.506842:0:8448:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8ebaae74e8215b49 00010000:00010000:3.0:1789478365.510566:0:8448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1789478365.511443:0:8448:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789478365.513369:0:8448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789478365.513659:0:8448:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1789478365.517161:0:8448:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1789478365.517534:0:8448:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1789478365.522253:0:8448:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1789478365.523495:0:8448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789478365.523506:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789478365.523512:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478365.523514:0:8448:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789478365.523518:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789478365.523521:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478365.523523:0:8448:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789478365.523525:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789478365.523527:0:8448:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789478365.523548:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789478365.523551:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478365.523552:0:8448:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789478365.523555:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789478365.524196:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789478365.524224:0:8423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789478365.524281:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc029de600/0x8ebaae74e8215b34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215b3b expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478365.524305:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc029de600/0x8ebaae74e8215b34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215b3b expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478365.524315:0:8423:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebc40e0d800 from 1 10000000:01000000:3.0:1789478365.524317:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789478365.524350:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc421ede00/0x8ebaae74e8215b50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478365.524357:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc421ede00/0x8ebaae74e8215b50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478365.524368:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc421ede00/0x8ebaae74e8215b50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478365.524391:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09124a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964366208:0@lo:101: 00000100:00100000:3.0:1789478365.524452:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478365.524487:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40dfc900 going to sleep for 11 seconds 00000100:00100000:0.0:1789478365.524688:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964366208 00000100:00100000:0.0:1789478365.524701:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964366208 00000100:00100000:2.0:1789478365.524862:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789478365.524876:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+14:8423:x1876403964366208:12345-0@lo:101: 00010000:00010000:2.0:1789478365.524890:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478365.524906:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc00030a00/0x8ebaae74e8215b57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215b50 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.524995:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc00030a00/0x8ebaae74e8215b57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215b50 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.525006:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc00030a00/0x8ebaae74e8215b57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215b50 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.525015:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc00030a00, rc 0) 00000100:00100000:2.0:1789478365.525071:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+15:8423:x1876403964366208:12345-0@lo:101: Request processed in 200us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478365.525077:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789478365.525119:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09124a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964366208:0@lo:101: 00010000:00010000:3.0:1789478365.525154:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc421ede00/0x8ebaae74e8215b50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215b57 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478365.525163:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc421ede00/0x8ebaae74e8215b50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215b57 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478365.525275:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09124a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964366336:0@lo:501: 00000100:00100000:3.0:1789478365.525304:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478365.525332:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40dfc900 going to sleep for 11 seconds 00000100:00100000:1.0:1789478365.525349:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964366336 00000100:00100000:1.0:1789478365.525354:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964366336 00000100:00100000:1.0:1789478365.525389:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789478365.525397:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+15:8423:x1876403964366336:12345-0@lo:501: 00000100:00100000:1.0:1789478365.525498:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+15:8423:x1876403964366336:12345-0@lo:501: Request processed in 102us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478365.525505:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789478365.525646:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09124a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964366336:0@lo:501: 00000100:00100000:3.0:1789478365.525682:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09124a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964366464:0@lo:503: 00000100:00100000:3.0:1789478365.525715:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478365.525733:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40dfc900 going to sleep for 11 seconds 00000100:00100000:2.0:1789478365.525743:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964366464 00000100:00100000:2.0:1789478365.525748:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964366464 00000100:00100000:2.0:1789478365.525793:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789478365.525799:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+15:8423:x1876403964366464:12345-0@lo:503: 00000100:00100000:2.0:1789478365.525880:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+15:8423:x1876403964366464:12345-0@lo:503: Request processed in 81us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478365.525887:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789478365.525911:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09124a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964366464:0@lo:503: 00000040:00080000:3.0:1789478365.526144:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789478365.526210:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09124a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964366592:0@lo:502: 00000100:00100000:3.0:1789478365.526240:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478365.526257:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40dfc900 going to sleep for 11 seconds 00000100:00100000:2.0:1789478365.526274:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964366592 00000100:00100000:2.0:1789478365.526279:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964366592 00000100:00100000:2.0:1789478365.526308:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789478365.526314:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+15:8423:x1876403964366592:12345-0@lo:502: 00000100:00100000:2.0:1789478365.526388:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+15:8423:x1876403964366592:12345-0@lo:502: Request processed in 73us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478365.526395:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789478365.526407:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09124a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964366592:0@lo:502: 00000040:00080000:3.0:1789478365.526577:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789478365.526653:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789478365.526673:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09124a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964366720:0@lo:502: 00000100:00100000:3.0:1789478365.526707:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478365.526730:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40dfca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789478365.526836:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964366720 00000100:00100000:2.0:1789478365.526840:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964366720 00000100:00100000:2.0:1789478365.526861:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789478365.526873:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+15:8423:x1876403964366720:12345-0@lo:502: 00000100:00100000:2.0:1789478365.526939:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+15:8423:x1876403964366720:12345-0@lo:502: Request processed in 66us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478365.526945:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789478365.526978:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09124a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964366720:0@lo:502: 00000040:00080000:1.0:1789478365.527023:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789478365.527031:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789478365.527390:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789478365.527400:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478365.527402:0:8452:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789478365.527408:0:8452:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ebc40e0d800 00000020:00000080:2.0:1789478365.527410:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789478365.527422:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789478365.527424:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478365.527425:0:8452:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789478365.527428:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789478365.527528:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789478365.527553:0:8423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789478365.527571:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc421ede00/0x8ebaae74e8215b50 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215b57 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.527582:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc421ede00/0x8ebaae74e8215b50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215b57 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478365.527656:0:8423:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789478365.527660:0:8423:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ebc40e0d800 10000000:01000000:1.0:1789478365.527663:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ebc40e0d800 10000000:01000000:1.0:1789478365.527671:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789478365.527683:0:8423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ebc40e0d800 from 1 10000000:01000000:1.0:1789478365.527685:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789478365.527711:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc029de400/0x8ebaae74e8215b5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.527719:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc029de400/0x8ebaae74e8215b5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.527729:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc029de400/0x8ebaae74e8215b5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478365.527743:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964366848:0@lo:101: 00000100:00100000:1.0:1789478365.527781:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478365.527817:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02bc8000 going to sleep for 11 seconds 00000100:00100000:2.0:1789478365.527862:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964366848 00000100:00100000:2.0:1789478365.527868:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964366848 00000100:00100000:2.0:1789478365.527901:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789478365.527909:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+15:8423:x1876403964366848:12345-0@lo:101: 00010000:00010000:2.0:1789478365.527918:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478365.527930:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc00031000/0x8ebaae74e8215b65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215b5e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.527950:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc00031000/0x8ebaae74e8215b65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215b5e expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.527959:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc00031000/0x8ebaae74e8215b65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215b5e expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.527966:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc00031000, rc 0) 00000100:00100000:2.0:1789478365.528006:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+16:8423:x1876403964366848:12345-0@lo:101: Request processed in 98us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478365.528021:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789478365.528110:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964366848:0@lo:101: 00010000:00010000:1.0:1789478365.528123:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc029de400/0x8ebaae74e8215b5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215b65 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.528132:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc029de400/0x8ebaae74e8215b5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215b65 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478365.528210:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964366976:0@lo:501: 00000100:00100000:1.0:1789478365.528237:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478365.528252:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02bc8000 going to sleep for 11 seconds 00000100:00100000:2.0:1789478365.528284:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964366976 00000100:00100000:2.0:1789478365.528287:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964366976 00000100:00100000:2.0:1789478365.528309:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789478365.528317:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:8423:x1876403964366976:12345-0@lo:501: 00000100:00100000:2.0:1789478365.528406:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:8423:x1876403964366976:12345-0@lo:501: Request processed in 90us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478365.528411:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789478365.528459:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964366976:0@lo:501: 00000100:00100000:1.0:1789478365.528479:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964367104:0@lo:503: 00000100:00100000:1.0:1789478365.528508:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478365.528525:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02bc8000 going to sleep for 11 seconds 00000100:00100000:3.0:1789478365.528552:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964367104 00000100:00100000:3.0:1789478365.528557:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964367104 00000100:00100000:3.0:1789478365.528588:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789478365.528613:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+16:8423:x1876403964367104:12345-0@lo:503: 00000100:00100000:3.0:1789478365.528696:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+16:8423:x1876403964367104:12345-0@lo:503: Request processed in 101us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478365.528703:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789478365.528709:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964367104:0@lo:503: 00000040:00080000:0.0:1789478365.528951:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789478365.529011:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964367232:0@lo:502: 00000100:00100000:0.0:1789478365.529052:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478365.529095:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05530780 going to sleep for 11 seconds 00000100:00100000:2.0:1789478365.529103:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964367232 00000100:00100000:2.0:1789478365.529109:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964367232 00000100:00100000:2.0:1789478365.529136:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789478365.529143:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:8423:x1876403964367232:12345-0@lo:502: 00000100:00100000:2.0:1789478365.529216:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:8423:x1876403964367232:12345-0@lo:502: Request processed in 73us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478365.529222:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789478365.529245:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964367232:0@lo:502: 00000040:00080000:0.0:1789478365.529460:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789478365.529485:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789478365.529501:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789478365.529517:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789478365.529535:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789478365.529552:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789478365.529572:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789478365.529617:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789478365.529642:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789478365.529663:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789478365.529686:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789478365.529721:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789478365.529738:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789478365.529755:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789478365.529776:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789478365.529792:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789478365.529809:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789478365.529830:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789478365.529850:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789478365.529867:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789478365.529879:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789478365.529890:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789478365.529902:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789478365.529912:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789478365.529936:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789478365.529948:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789478365.529960:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789478365.529983:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1789478365.529998:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789478365.530010:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1789478365.530025:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1789478365.530040:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1789478365.530055:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1789478365.530069:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1789478365.530082:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1789478365.530115:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1789478365.530134:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1789478365.530225:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964367360:0@lo:502: 00000100:00100000:0.0:1789478365.530278:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478365.530325:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05530780 going to sleep for 11 seconds 00000100:00100000:3.0:1789478365.530439:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964367360 00000100:00100000:3.0:1789478365.530444:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964367360 00000100:00100000:3.0:1789478365.530500:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789478365.530506:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+16:8423:x1876403964367360:12345-0@lo:502: 00000100:00100000:3.0:1789478365.530623:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+16:8423:x1876403964367360:12345-0@lo:502: Request processed in 114us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478365.530629:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789478365.530707:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964367360:0@lo:502: 00000040:00080000:2.0:1789478365.530743:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1789478365.530863:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1789478365.531346:0:8453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789478365.531368:0:8453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8ebb022999b8) 00000020:00000080:3.0:1789478365.531390:0:8453:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1789478365.531480:0:8453:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ebc40e0d800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789478365.531483:0:8453:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ebc40e0d800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789478365.531485:0:8453:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ebc40e0d800 3 00010000:00080000:3.0:1789478365.531508:0:8453:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ebc091ab000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.111@tcp at head 00010000:00010000:2.0:1789478365.533588:0:8453:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1789478365.533855:0:8453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789478365.533899:0:8453:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789478365.533910:0:8453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8ebaae74e8215b73 00000100:00080000:2.0:1789478365.533921:0:8453:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789478365.533932:0:8453:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ebc091ab000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1789478365.533966:0:8453:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebc40ecc380 x1876403964367488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789478365.534008:0:8453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789478365.534269:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876403964367488:0@lo:38: 00000100:00100000:3.0:1789478365.534330:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478365.534423:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964367488 00000100:00100000:2.0:1789478365.534430:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964367488 00000100:00100000:2.0:1789478365.534465:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789478365.534472:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876403964367488:12345-0@lo:38: 00010000:00080000:2.0:1789478365.534493:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:2.0:1789478365.534522:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8ebaae74e8215b7a 00000004:00100000:2.0:1789478365.534535:0:6518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789478365.534562:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8ebb01bdb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789478365.534639:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876403964367488:12345-0@lo:38: Request processed in 166us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478365.534648:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789478365.534728:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964367744:0@lo:400: 00000100:00100000:3.0:1789478365.534758:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478365.534778:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789478365.534785:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964367872:0@lo:400: 00000100:00100000:0.0:1789478365.534797:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964367744 00000100:00100000:0.0:1789478365.534803:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964367744 00000100:00100000:3.0:1789478365.534808:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478365.534840:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964367872 00000100:00100000:0.0:1789478365.534843:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964367872 00010000:00080000:3.0:1789478365.534859:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ebc40ecc380 x1876403964367488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789478375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478365.534872:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00100000:0.0:1789478365.534879:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1789478365.534880:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789478365.534889:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00100000:0.0:1789478365.534891:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964367744:12345-0@lo:400: 00000100:00080000:3.0:1789478365.534897:0:3644:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789478365.534900:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc091ab000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789478365.534908:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876403964367488:0@lo:38: 00000100:00100000:0.0:1789478365.534957:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964367744:12345-0@lo:400: Request processed in 69us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478365.534965:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789478365.535008:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789478365.535017:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964367872:12345-0@lo:400: 00000100:00100000:3.0:1789478365.535077:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964367744:0@lo:400: 00000100:00100000:2.0:1789478365.535132:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964367872:12345-0@lo:400: Request processed in 116us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478365.535140:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789478365.535187:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964367872:0@lo:400: 00000100:00100000:1.0:1789478365.535819:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876403964367616:0@lo:400: 00000100:00100000:1.0:1789478365.535858:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478365.535892:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789478365.535898:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876403964368000:0@lo:400: 00000100:00100000:1.0:1789478365.535922:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478365.535965:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964367616 00000100:00100000:3.0:1789478365.535971:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964367616 00000100:00100000:3.0:1789478365.536008:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964368000 00000100:00100000:3.0:1789478365.536011:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964368000 00000100:00100000:3.0:1789478365.536027:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789478365.536034:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876403964367616:12345-0@lo:400: 00000100:00100000:3.0:1789478365.536080:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876403964367616:12345-0@lo:400: Request processed in 45us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478365.536099:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789478365.536116:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789478365.536120:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ebc34cb7800 x1876403964367616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478365.536124:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876403964368000:12345-0@lo:400: 00000100:00100000:1.0:1789478365.536141:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876403964367616:0@lo:400: 00000100:00100000:3.0:1789478365.536160:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876403964368000:12345-0@lo:400: Request processed in 38us (236us total) trans 0 rc 0/0 00010000:00080000:1.0:1789478365.536167:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ebc34cb7100 x1876403964368000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478365.536168:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789478365.536181:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876403964368000:0@lo:400: 00000020:01000004:0.0:1789478365.536760:0:8453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789478365.536785:0:8453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8ebc3bd10000) 00000020:00000080:0.0:1789478365.536807:0:8453:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1789478365.538378:0:8453:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ebc40e0d800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789478365.538386:0:8453:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ebc40e0d800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789478365.538389:0:8453:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ebc40e0d800 3 00010000:00080000:0.0:1789478365.538436:0:8453:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ebc35e73000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.111@tcp at head 00010000:00010000:1.0:1789478365.541764:0:8453:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1789478365.542021:0:8453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789478365.542068:0:8453:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789478365.542095:0:8453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x8ebaae74e8215b88 00000100:00080000:1.0:1789478365.542111:0:8453:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789478365.542125:0:8453:0:(import.c:625:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8ebc35e73000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1789478365.542190:0:8453:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb01b73480 x1876403964368128/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789478365.542215:0:8453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789478365.542536:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876403964368128:0@lo:38: 00000100:00100000:3.0:1789478365.542636:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478365.542679:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964368128 00000100:00100000:0.0:1789478365.542688:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964368128 00000100:00100000:0.0:1789478365.542730:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789478365.542739:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876403964368128:12345-0@lo:38: 00010000:00080000:0.0:1789478365.542763:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:0.0:1789478365.542808:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x8ebaae74e8215b8f 00000004:00100000:0.0:1789478365.542823:0:6518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789478365.543351:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8ebc35e77800 : changing import state from RECOVER to FULL 00000040:00080000:2.0:1789478365.543708:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1789478365.543773:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1789478365.543799:0:8423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789478365.543819:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc029de400/0x8ebaae74e8215b5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215b65 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478365.543830:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc029de400/0x8ebaae74e8215b5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215b65 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789478365.543881:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789478365.543883:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789478365.543885:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478365.543886:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478365.543887:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478365.543889:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478365.543890:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789478365.543891:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789478365.543893:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789478365.543895:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478365.543896:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789478365.543899:0:8423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789478365.543902:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789478365.543903:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789478365.543904:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478365.543905:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478365.543906:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478365.543907:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478365.543908:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789478365.543909:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789478365.543910:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789478365.543911:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478365.543912:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789478365.543928:0:8423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789478365.543940:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ece680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964368256:0@lo:253: 00000100:00100000:2.0:1789478365.543970:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478365.543997:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc0808e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789478365.544024:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964368256 00000100:00100000:2.0:1789478365.544029:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964368256 00000100:00100000:2.0:1789478365.544078:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789478365.544097:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:8423:x1876403964368256:12345-0@lo:253: 20000000:01000000:2.0:1789478365.544125:0:6511:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789478365.544140:0:6511:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789478365.544404:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876403964368128:12345-0@lo:38: Request processed in 1664us (1766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478365.544414:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789478365.544483:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ebb01b73480 x1876403964368128/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789478375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478365.544496:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789478365.544507:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789478365.544516:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789478365.544535:0:3644:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789478365.544538:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc35e73000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789478365.544545:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876403964368128:0@lo:38: 20000000:01000000:0.0:1789478365.550498:0:6511:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789478365.550544:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789478365.550904:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:8423:x1876403964368256:12345-0@lo:253: Request processed in 6814us (6927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478365.550915:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789478365.550997:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ece680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:8423:1876403964368256:0@lo:253: 20000000:01000000:3.0:1789478365.551000:0:6533:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789478365.551005:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789478365.551022:0:8423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00010000:00010000:3.0:1789478365.551026:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215b96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789478365.551026:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789478365.551030:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789478365.551032:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478365.551035:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478365.551037:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478365.551040:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478365.551042:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789478365.551044:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789478365.551045:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789478365.551047:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478365.551049:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:3.0:1789478365.551050:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc029de800/0x8ebaae74e8215ad9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215ad2 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478365.551060:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc35b66400/0x8ebaae74e8215af5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215aee expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:2.0:1789478365.551061:0:8423:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789478365.551099:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215b96 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478365.551132:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc35b66400/0x8ebaae74e8215af5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215aee expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478365.551145:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc35b66400/0x8ebaae74e8215af5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215aee expref: 15 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478365.551157:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09127100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1876403964368384:0@lo:104: 00000100:00100000:3.0:1789478365.551191:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789478365.551236:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc029de800/0x8ebaae74e8215ad9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215ad2 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478365.551244:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc029de800/0x8ebaae74e8215ad9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215ad2 expref: 15 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478365.551253:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09125f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1876403964368512:0@lo:104: 00000100:00100000:1.0:1789478365.551272:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789478365.551273:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40dfc000 going to sleep for 11 seconds 00000100:00100000:1.0:1789478365.551296:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478365.551325:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964368384 00000100:00100000:1.0:1789478365.551336:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964368384 00000100:00100000:3.0:1789478365.551343:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964368512 00000100:00100000:3.0:1789478365.551348:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964368512 00000100:00100000:1.0:1789478365.551374:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789478365.551386:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+4:6533:x1876403964368384:12345-0@lo:104: 00010000:00010000:1.0:1789478365.551399:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215aee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215af5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.551468:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789478365.551470:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09127100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1876403964368384:0@lo:104: 00000100:00100000:1.0:1789478365.551480:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+4:6533:x1876403964368384:12345-0@lo:104: Request processed in 93us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478365.551486:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1789478365.551517:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789478365.551521:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1789478365.551526:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215aee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215af5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478365.551531:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+3:6533:x1876403964368512:12345-0@lo:104: 00010000:00010000:0.0:1789478365.551541:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc00030000 already unused, calling callback (ffffffffc1383c20) 00010000:00010000:1.0:1789478365.551545:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66000/0x8ebaae74e8215ad2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215ad9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478365.551547:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215aee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215af5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.551566:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215aee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215af5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478365.551574:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215aee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215af5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.551610:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789478365.551614:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+3:6533:x1876403964368512:12345-0@lo:104: Request processed in 87us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478365.551618:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1789478365.551633:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789478365.551636:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66000/0x8ebaae74e8215ad2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215ad9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.551649:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b66000 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:1.0:1789478365.551651:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66000/0x8ebaae74e8215ad2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215ad9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.551656:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66000/0x8ebaae74e8215ad2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215ad9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478365.551660:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66000/0x8ebaae74e8215ad2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215ad9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478365.551663:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789478365.551681:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66000/0x8ebaae74e8215ad2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215ad9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.551685:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789478365.551695:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66000/0x8ebaae74e8215ad2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215ad9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.551699:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66000/0x8ebaae74e8215ad2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215ad9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.551707:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478365.551708:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478365.551709:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789478365.551718:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1789478365.551722:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964368640:0@lo:103: 00000100:00100000:1.0:1789478365.551743:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789478365.551748:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215aee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215af5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.551757:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478365.551771:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215aee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215af5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478365.551778:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215aee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215af5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478365.551785:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964368640 00000100:00100000:1.0:1789478365.551789:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964368640 00010000:00010000:0.0:1789478365.551795:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478365.551798:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478365.551800:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478365.551804:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc029de800/0x8ebaae74e8215ad9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215ad2 expref: 16 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478365.551828:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789478365.551834:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:3648:x1876403964368640:12345-0@lo:103: 00010000:00010000:1.0:1789478365.551842:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478365.551846:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc029de800/0x8ebaae74e8215ad9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215ad2 expref: 16 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.551854:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc029de800/0x8ebaae74e8215ad9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215ad2 expref: 16 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478365.551860:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964368768:0@lo:103: 00010000:00010000:1.0:1789478365.551868:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478365.551901:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478365.551905:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:3648:x1876403964368640:12345-0@lo:103: Request processed in 70us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478365.551911:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789478365.551921:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964368768 00000100:00100000:1.0:1789478365.551924:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964368768 00010000:00010000:1.0:1789478365.551934:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc35b66400/0x8ebaae74e8215af5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215aee expref: 16 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478365.551950:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1789478365.551956:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc029de800/0x8ebaae74e8215ad9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215ad2 expref: 16 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478365.551956:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09124a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:3645:x1876403964368768:12345-0@lo:103: 00010000:00010000:1.0:1789478365.551966:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478365.551970:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc35b66400/0x8ebaae74e8215af5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215aee expref: 15 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478365.551975:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09125f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1876403964368512:0@lo:104: 00010000:00010000:1.0:1789478365.551979:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc35b66400/0x8ebaae74e8215af5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215aee expref: 15 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.551995:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc35b66400/0x8ebaae74e8215af5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215aee expref: 15 pid: 6510 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478365.552009:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215b96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.552010:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215b96 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.552027:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215b96 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478365.552074:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964368640:0@lo:103: 20000000:01000000:1.0:1789478365.552125:0:6502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003923730s 00010000:00010000:3.0:1789478365.552126:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215b96 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.552132:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215b96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478365.552138:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215b96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.552142:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215b96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.552152:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215b96 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.552159:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215b96 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.552165:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc421eca00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:1.0:1789478365.552169:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215b96 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.552185:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215b96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.552194:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215b96 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.552201:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215b96 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478365.552220:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478365.552251:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09124a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+14:3645:x1876403964368768:12345-0@lo:103: Request processed in 295us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478365.552257:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789478365.552282:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964368768:0@lo:103: 00080000:10000000:2.0:1789478365.555821:0:8423:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1789478365.556002:0:8423:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789478365.556215:0:8423:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1789478365.556385:0:8423:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789478365.556584:0:8423:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789478365.556881:0:8423:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1789478365.557810:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789478365.567842:0:8423:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789478365.567853:0:8423:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789478365.567961:0:8423:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789478365.568004:0:8423:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789478365.568025:0:8423:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789478365.568043:0:8423:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1789478365.568972:0:8423:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789478365.569171:0:8423:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1789478365.733296:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789478366.250191:0:8509:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789478366.251363:0:8509:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789478366.756854:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478367.782017:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478368.805726:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478368.996837:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789478368.996861:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964368896:0@lo:41: 00000100:00100000:3.0:1789478368.996917:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478368.996969:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964369024:0@lo:41: 00000100:00100000:2.0:1789478368.997114:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964368896 00000100:00100000:2.0:1789478368.997123:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964368896 00000100:00100000:2.0:1789478368.997175:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789478368.997186:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964368896:12345-0@lo:41: 00000004:00000024:2.0:1789478368.997217:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789478368.997340:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964368896:12345-0@lo:41: Request processed in 155us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478368.997347:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789478368.997401:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964368896:0@lo:41: 00000100:00100000:3.0:1789478368.997488:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478368.997528:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964369024 00000100:00100000:3.0:1789478368.997533:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964369024 00000100:00100000:3.0:1789478368.997557:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789478368.997564:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964369024:12345-0@lo:41: 00000004:00000024:3.0:1789478368.997674:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1789478368.998002:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964369024:12345-0@lo:41: Request processed in 437us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478368.998009:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789478369.000443:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964369024:0@lo:41: 00010000:00010000:1.0:1789478369.830179:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478370.853801:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478371.047334:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964369152:0@lo:400: 00000100:00100000:3.0:1789478371.047396:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478371.047437:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876403964369664:0@lo:400: 00000100:00100000:3.0:1789478371.047461:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478371.047491:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789478371.047496:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964369536:0@lo:400: 00000100:00100000:3.0:1789478371.047518:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478371.047551:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964369280:0@lo:400: 00000100:00100000:3.0:1789478371.047571:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478371.047587:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964369792:0@lo:400: 00000100:00100000:3.0:1789478371.047626:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478371.047642:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789478371.047648:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964369408:0@lo:400: 00000100:00100000:3.0:1789478371.049452:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478371.049491:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964369920:0@lo:400: 00000100:00100000:3.0:1789478371.049537:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478371.049574:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964369152 00000100:00100000:3.0:1789478371.049582:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964369152 00000100:00100000:3.0:1789478371.049652:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789478371.049897:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964369536 00000100:00100000:2.0:1789478371.049902:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964369536 00000100:00100000:2.0:1789478371.049930:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964369408 00000100:00100000:2.0:1789478371.049938:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964369408 00000100:00100000:2.0:1789478371.049955:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789478371.049962:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964369536:12345-0@lo:400: 00000100:00100000:2.0:1789478371.050133:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964369536:12345-0@lo:400: Request processed in 171us (2613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478371.050141:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789478371.050159:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789478371.050165:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964369408:12345-0@lo:400: 00000100:00100000:2.0:1789478371.050200:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964369408:12345-0@lo:400: Request processed in 36us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478371.050206:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789478371.050241:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964369536:0@lo:400: 00000100:00100000:2.0:1789478371.050275:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964369408:0@lo:400: 00000100:00100000:3.0:1789478371.050365:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+14:3648:x1876403964369152:12345-0@lo:400: 00000100:00100000:3.0:1789478371.050409:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+14:3648:x1876403964369152:12345-0@lo:400: Request processed in 750us (3013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478371.050415:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789478371.050444:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964369664 00000100:00100000:3.0:1789478371.050448:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964369664 00000100:00100000:3.0:1789478371.050465:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964369280 00000100:00100000:3.0:1789478371.050468:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964369280 00000100:00100000:3.0:1789478371.050478:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964369792 00000100:00100000:3.0:1789478371.050481:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964369792 00000100:00100000:3.0:1789478371.050498:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964369920 00000100:00100000:3.0:1789478371.050501:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964369920 00000100:00100000:3.0:1789478371.050514:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789478371.050520:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876403964369664:12345-0@lo:400: 00000100:00100000:3.0:1789478371.050558:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876403964369664:12345-0@lo:400: Request processed in 38us (3095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478371.050564:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789478371.050576:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789478371.050581:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964369280:12345-0@lo:400: 00000100:00100000:3.0:1789478371.050633:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964369280:12345-0@lo:400: Request processed in 52us (3060us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478371.050638:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789478371.050651:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789478371.050670:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964369792:12345-0@lo:400: 00000100:00100000:3.0:1789478371.050698:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964369792:12345-0@lo:400: Request processed in 42us (3072us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478371.050704:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789478371.050716:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789478371.050722:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964369920:12345-0@lo:400: 00000100:00100000:3.0:1789478371.050747:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964369920:12345-0@lo:400: Request processed in 26us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478371.050753:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789478371.050854:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789478371.050858:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789478371.050877:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964369152:0@lo:400: 00010000:00080000:2.0:1789478371.050890:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc09127480 x1876403964369664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478371.050900:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876403964369664:0@lo:400: 00010000:00080000:2.0:1789478371.050929:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc09125f80 x1876403964369920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478371.050937:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964369920:0@lo:400: 00010000:00080000:2.0:1789478371.050947:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc09124380 x1876403964369280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478371.050966:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964369280:0@lo:400: 00010000:00080000:2.0:1789478371.050981:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc09126680 x1876403964369792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478371.050988:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964369792:0@lo:400: 00000001:02000400:0.0:1789478371.673559:0:8799:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789478371.878217:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789478372.068654:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789478372.068661:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ebc34d64800 from 30 10000000:01000000:1.0:1789478372.068666:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789478372.068702:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc029df800/0x8ebaae74e8215b9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.068713:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc029df800/0x8ebaae74e8215b9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.068725:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc029df800/0x8ebaae74e8215b9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478372.068747:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964370048:0@lo:101: 00000100:00100000:1.0:1789478372.068804:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478372.068841:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34dfcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789478372.068920:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964370048 00000100:00100000:0.0:1789478372.068927:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964370048 00000100:00100000:0.0:1789478372.068975:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789478372.068984:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10000850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+14:6514:x1876403964370048:12345-0@lo:101: 00010000:00010000:0.0:1789478372.068995:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478372.069008:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc35b67e00/0x8ebaae74e8215ba4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215b9d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478372.069031:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc35b67e00/0x8ebaae74e8215ba4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215b9d expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478372.069039:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc35b67e00/0x8ebaae74e8215ba4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215b9d expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478372.069047:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b67e00, rc 0) 00000100:00100000:0.0:1789478372.069093:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10000850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+15:6514:x1876403964370048:12345-0@lo:101: Request processed in 110us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.069197:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964370048:0@lo:101: 00010000:00010000:1.0:1789478372.069209:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc029df800/0x8ebaae74e8215b9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215ba4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.069218:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc029df800/0x8ebaae74e8215b9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215ba4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478372.069286:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964370176:0@lo:501: 00000100:00100000:1.0:1789478372.069310:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478372.069328:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34dfcb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789478372.069340:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964370176 00000100:00100000:1.0:1789478372.069343:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964370176 00000100:00100000:1.0:1789478372.069361:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789478372.069367:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:6514:x1876403964370176:12345-0@lo:501: 00000100:00100000:1.0:1789478372.069468:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:6514:x1876403964370176:12345-0@lo:501: Request processed in 101us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.069475:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789478372.069508:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964370176:0@lo:501: 00000100:00100000:1.0:1789478372.069532:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964370304:0@lo:503: 00000100:00100000:1.0:1789478372.069579:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478372.069608:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34dfcb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789478372.069619:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964370304 00000100:00100000:1.0:1789478372.069622:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964370304 00000100:00100000:1.0:1789478372.069638:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789478372.069644:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:6514:x1876403964370304:12345-0@lo:503: 00000100:00100000:1.0:1789478372.069714:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:6514:x1876403964370304:12345-0@lo:503: Request processed in 70us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.069720:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789478372.069756:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964370304:0@lo:503: 00000100:00100000:1.0:1789478372.069907:0:8820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:8820:1876403964370432:0@lo:502: 00000100:00100000:1.0:1789478372.069938:0:8820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478372.069961:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964370432 00000100:00100000:1.0:1789478372.069965:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964370432 00000100:00100000:1.0:1789478372.069982:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789478372.069988:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:8820:x1876403964370432:12345-0@lo:502: 00000100:00100000:1.0:1789478372.070064:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:8820:x1876403964370432:12345-0@lo:502: Request processed in 64us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.070070:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789478372.070110:0:8820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34dfc480 going to sleep for 11 seconds 00000100:00100000:1.0:1789478372.070121:0:8820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:8820:1876403964370432:0@lo:502: 00000100:00100000:1.0:1789478372.070159:0:8820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:8820:1876403964370560:0@lo:502: 00000100:00100000:1.0:1789478372.070188:0:8820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478372.070206:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964370560 00000100:00100000:1.0:1789478372.070209:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964370560 00000100:00100000:1.0:1789478372.070225:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789478372.070231:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10002850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:8820:x1876403964370560:12345-0@lo:502: 00000100:00100000:1.0:1789478372.070286:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10002850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:8820:x1876403964370560:12345-0@lo:502: Request processed in 54us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.070292:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789478372.070317:0:8820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34dfc480 going to sleep for 11 seconds 00000100:00100000:1.0:1789478372.070328:0:8820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:8820:1876403964370560:0@lo:502: 00000040:00080000:1.0:1789478372.070345:0:8820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789478372.070390:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789478372.070405:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789478372.070411:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc029df800/0x8ebaae74e8215b9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215ba4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.070420:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc029df800/0x8ebaae74e8215b9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215ba4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478372.070433:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789478372.070435:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ebc34d64800 from 5 10000000:01000000:1.0:1789478372.070438:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789478372.070456:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc029de800/0x8ebaae74e8215bab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.070463:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc029de800/0x8ebaae74e8215bab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.070471:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc029de800/0x8ebaae74e8215bab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478372.070482:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964370688:0@lo:101: 00000100:00100000:1.0:1789478372.070505:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478372.070518:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34dfc480 going to sleep for 11 seconds 00000100:00100000:1.0:1789478372.070528:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964370688 00000100:00100000:1.0:1789478372.070531:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964370688 00000100:00100000:1.0:1789478372.070548:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789478372.070553:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10001050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:6514:x1876403964370688:12345-0@lo:101: 00010000:00010000:1.0:1789478372.070560:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478372.070570:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc029df200/0x8ebaae74e8215bb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215bab expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.070583:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc029df200/0x8ebaae74e8215bb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215bab expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.070614:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc029df200/0x8ebaae74e8215bb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215bab expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.070633:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029df200, rc 0) 00000100:00100000:1.0:1789478372.070661:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10001050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+17:6514:x1876403964370688:12345-0@lo:101: Request processed in 107us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.070667:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789478372.070693:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964370688:0@lo:101: 00010000:00010000:1.0:1789478372.070702:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc029de800/0x8ebaae74e8215bab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215bb2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.070710:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc029de800/0x8ebaae74e8215bab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215bb2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478372.070750:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964370816:0@lo:256: 00000100:00100000:1.0:1789478372.070777:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478372.070790:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34dfc480 going to sleep for 11 seconds 00000100:00100000:1.0:1789478372.070800:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964370816 00000100:00100000:1.0:1789478372.070803:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964370816 00000100:00100000:1.0:1789478372.070819:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789478372.070825:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+17:6514:x1876403964370816:12345-0@lo:256: 20000000:01000000:1.0:1789478372.070835:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789478372.070849:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789478372.070851:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789478372.070918:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+17:6514:x1876403964370816:12345-0@lo:256: Request processed in 93us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.070925:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789478372.070953:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964370816:0@lo:256: 10000000:01000000:1.0:1789478372.070991:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789478372.071000:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc029de800/0x8ebaae74e8215bab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215bb2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.071006:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc029de800/0x8ebaae74e8215bab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215bb2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478372.071013:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789478372.071015:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1789478372.071017:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789478372.071030:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc029df600/0x8ebaae74e8215bb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.071037:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc029df600/0x8ebaae74e8215bb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.071044:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc029df600/0x8ebaae74e8215bb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478372.071066:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964370944:0@lo:101: 00000100:00100000:1.0:1789478372.071088:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478372.071100:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc054833c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478372.071109:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964370944 00000100:00100000:1.0:1789478372.071112:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964370944 00000100:00100000:1.0:1789478372.071130:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789478372.071135:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+17:6514:x1876403964370944:12345-0@lo:101: 00010000:00010000:1.0:1789478372.071140:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478372.071147:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc029df000/0x8ebaae74e8215bc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215bb9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.071160:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc029df000/0x8ebaae74e8215bc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215bb9 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.071172:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc029df000/0x8ebaae74e8215bc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215bb9 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.071178:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029df000, rc 0) 00000100:00100000:1.0:1789478372.071210:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964370944:12345-0@lo:101: Request processed in 70us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.071215:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789478372.071243:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964370944:0@lo:101: 00010000:00010000:1.0:1789478372.071253:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc029df600/0x8ebaae74e8215bb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215bc0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.071258:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc029df600/0x8ebaae74e8215bb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215bc0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478372.071294:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964371072:0@lo:501: 00000100:00100000:1.0:1789478372.071316:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478372.071328:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc054833c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478372.071338:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964371072 00000100:00100000:1.0:1789478372.071341:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964371072 00000100:00100000:1.0:1789478372.071357:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789478372.071362:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964371072:12345-0@lo:501: 00000100:00100000:1.0:1789478372.071438:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964371072:12345-0@lo:501: Request processed in 75us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.071444:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789478372.071468:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964371072:0@lo:501: 00000100:00100000:1.0:1789478372.071489:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964371200:0@lo:503: 00000100:00100000:1.0:1789478372.071524:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478372.071535:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc054833c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478372.071545:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964371200 00000100:00100000:1.0:1789478372.071548:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964371200 00000100:00100000:1.0:1789478372.071563:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789478372.071568:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964371200:12345-0@lo:503: 00000100:00100000:1.0:1789478372.071649:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964371200:12345-0@lo:503: Request processed in 80us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.071655:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789478372.071693:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964371200:0@lo:503: 00000100:00100000:3.0:1789478372.072085:0:8821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c962a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:8821:1876403964371328:0@lo:502: 00000100:00100000:3.0:1789478372.072129:0:8821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478372.072150:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964371328 00000100:00100000:3.0:1789478372.072154:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964371328 00000100:00100000:3.0:1789478372.072175:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789478372.072181:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+18:8821:x1876403964371328:12345-0@lo:502: 00000100:00100000:3.0:1789478372.072242:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+18:8821:x1876403964371328:12345-0@lo:502: Request processed in 61us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478372.072253:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789478372.072285:0:8821:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34ef7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789478372.072297:0:8821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c962a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:8821:1876403964371328:0@lo:502: 00000020:01000000:3.0:1789478372.072316:0:8821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789478372.072322:0:8821:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789478372.072328:0:8821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478372.072330:0:8821:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789478372.072335:0:8821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789478372.072338:0:8821:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:01000000:3.0:1789478372.072357:0:8821:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789478372.072360:0:8821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789478372.072372:0:8821:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8ebb0229b370) 00000020:00000080:3.0:1789478372.072389:0:8821:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1789478372.072394:0:8821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789478372.072457:0:8821:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1789478372.072462:0:8821:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789478372.072469:0:8821:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8ebaae74e8215bce 00010000:00080000:3.0:1789478372.072493:0:8821:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ebc34fac000@lustre-OST0000-osc-MDT0001: add connection 192.168.206.111@tcp at head 00010000:00010000:3.0:1789478372.072715:0:8821:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000100:00100000:0.0:1789478372.073326:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000040:01000000:3.0:1789478372.086898:0:8821:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789478372.086919:0:8821:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789478372.087111:0:8821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789478372.087333:0:8821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789478372.087431:0:8821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789478372.087518:0:8821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789478372.087978:0:8823:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789478372.087983:0:8823:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789478372.094577:0:8821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789478372.094612:0:8821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789478372.094655:0:8821:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789478372.094675:0:8821:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8ebaae74e8215bd5 00000100:00080000:1.0:1789478372.094685:0:8821:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789478372.094696:0:8821:0:(import.c:625:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ebc34fac000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1789478372.094726:0:8821:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb01b70000 x1876403964371456/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789478372.094788:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964371456:0@lo:8: 00000100:00100000:3.0:1789478372.094845:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789478372.094910:0:8821:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1789478372.094992:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964371584:0@lo:400: 00000100:00100000:1.0:1789478372.095020:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478372.095038:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964372096:0@lo:400: 00000100:00100000:1.0:1789478372.095074:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478372.095092:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789478372.095098:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964371712:0@lo:400: 00000100:00100000:1.0:1789478372.095120:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478372.095146:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964372224:0@lo:400: 00000100:00100000:1.0:1789478372.095168:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478372.095190:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876403964371968:0@lo:400: 00000100:00100000:1.0:1789478372.095210:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478372.095222:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789478372.095226:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964371840:0@lo:400: 00000100:00100000:1.0:1789478372.095245:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478372.095282:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964371584 00000100:00100000:1.0:1789478372.095289:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964371584 00000100:00100000:1.0:1789478372.095317:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964372096 00000100:00100000:1.0:1789478372.095319:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964372096 00000100:00100000:1.0:1789478372.095330:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964372224 00000100:00100000:1.0:1789478372.095332:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964372224 00000100:00100000:1.0:1789478372.095340:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964371968 00000100:00100000:1.0:1789478372.095343:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964371968 00000100:00100000:1.0:1789478372.095355:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789478372.095362:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964371584:12345-0@lo:400: 00000100:00100000:1.0:1789478372.095409:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964371584:12345-0@lo:400: Request processed in 47us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.095415:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789478372.095429:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789478372.095435:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964372096:12345-0@lo:400: 00000100:00100000:1.0:1789478372.095459:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964372096:12345-0@lo:400: Request processed in 25us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.095464:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789478372.095475:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789478372.095480:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964372224:12345-0@lo:400: 00000100:00100000:1.0:1789478372.095504:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964372224:12345-0@lo:400: Request processed in 24us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.095515:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789478372.095527:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789478372.095532:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876403964371968:12345-0@lo:400: 00000100:00100000:1.0:1789478372.095573:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876403964371968:12345-0@lo:400: Request processed in 41us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.095580:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1789478372.095636:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb01b73800 x1876403964371968/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478372.095647:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876403964371968:0@lo:400: 00010000:00080000:1.0:1789478372.095672:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb01b72300 x1876403964372224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478372.095680:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964372224:0@lo:400: 00010000:00080000:1.0:1789478372.095687:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb01b71500 x1876403964371584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478372.095694:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964371584:0@lo:400: 00010000:00080000:1.0:1789478372.095701:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb01b72d80 x1876403964372096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478372.095707:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964372096:0@lo:400: 00000020:01000000:1.0:1789478372.095757:0:8821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789478372.095762:0:8821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478372.095764:0:8821:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789478372.095766:0:8821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789478372.095770:0:8821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478372.095771:0:8821:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789478372.095779:0:8821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789478372.095782:0:8821:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789478372.095803:0:8821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b72d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:8821:1876403964372352:0@lo:502: 00000100:00100000:1.0:1789478372.095839:0:8821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478372.095861:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964372352 00000100:00100000:1.0:1789478372.095866:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964372352 00000100:00100000:1.0:1789478372.095892:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789478372.095898:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+17:8821:x1876403964372352:12345-0@lo:502: 00000100:00100000:1.0:1789478372.095986:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+17:8821:x1876403964372352:12345-0@lo:502: Request processed in 88us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.095992:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789478372.096027:0:8821:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34dfcb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789478372.096038:0:8821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b72d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:8821:1876403964372352:0@lo:502: 00000020:01000000:1.0:1789478372.096092:0:8821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789478372.096096:0:8821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478372.096098:0:8821:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789478372.096101:0:8821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:1.0:1789478372.096145:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1789478372.096161:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789478372.096170:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc029df600/0x8ebaae74e8215bb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215bc0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.096181:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc029df600/0x8ebaae74e8215bb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215bc0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478372.096190:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789478372.096192:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ebc0501d800 from 30 10000000:01000000:1.0:1789478372.096195:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789478372.096217:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc029df400/0x8ebaae74e8215bdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.096229:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc029df400/0x8ebaae74e8215bdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.096239:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc029df400/0x8ebaae74e8215bdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478372.096254:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964372480:0@lo:101: 00000100:00100000:1.0:1789478372.096279:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478372.096292:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34dfcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789478372.096385:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964371456 00000100:00100000:0.0:1789478372.096389:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964371456 00000100:00100000:0.0:1789478372.096411:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789478372.096417:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1876403964371456:12345-0@lo:8: 00010000:00080000:0.0:1789478372.096440:0:8430:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:0.0:1789478372.096463:0:8430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8ebaae74e8215be3 00002000:00100000:0.0:1789478372.096498:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8ebc35e72000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1789478372.096509:0:8430:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1789478372.096512:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789478372.096558:0:8430:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789478372.096754:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1789478372.096774:0:8430:0:(import.c:65:import_set_state_nolock()) ffff8ebc35e71800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789478372.097033:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964371712 00000100:00100000:2.0:1789478372.097038:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964371712 00000100:00100000:2.0:1789478372.097079:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964371840 00000100:00100000:2.0:1789478372.097081:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964371840 00000100:00100000:2.0:1789478372.097096:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789478372.097102:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964371712:12345-0@lo:400: 00000100:00100000:2.0:1789478372.097146:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964371712:12345-0@lo:400: Request processed in 44us (2024us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478372.097153:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789478372.097166:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789478372.097171:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964371840:12345-0@lo:400: 00000100:00100000:2.0:1789478372.097202:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964371840:12345-0@lo:400: Request processed in 31us (1957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478372.097207:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789478372.097254:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964371840:0@lo:400: 00000100:00100000:2.0:1789478372.097277:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964371712:0@lo:400: 00000100:00100000:1.0:1789478372.097767:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964372480 00000100:00100000:1.0:1789478372.097774:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964372480 00000100:00100000:1.0:1789478372.097804:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789478372.097810:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+17:6514:x1876403964372480:12345-0@lo:101: 00010000:00010000:1.0:1789478372.097819:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478372.097833:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc029dee00/0x8ebaae74e8215bea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215bdc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.097852:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc029dee00/0x8ebaae74e8215bea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215bdc expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.097862:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc029dee00/0x8ebaae74e8215bea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215bdc expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.097869:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029dee00, rc 0) 00000100:00100000:1.0:1789478372.097903:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964372480:12345-0@lo:101: Request processed in 93us (1623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.097909:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789478372.097941:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964372480:0@lo:101: 00010000:00010000:1.0:1789478372.097961:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc029df400/0x8ebaae74e8215bdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215bea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.097970:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc029df400/0x8ebaae74e8215bdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215bea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478372.098022:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964372608:0@lo:501: 00000100:00100000:1.0:1789478372.098061:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478372.098085:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34dfcb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789478372.098096:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964372608 00000100:00100000:1.0:1789478372.098099:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964372608 00000100:00100000:1.0:1789478372.098120:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789478372.098126:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964372608:12345-0@lo:501: 00000100:00100000:1.0:1789478372.098216:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964372608:12345-0@lo:501: Request processed in 90us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.098222:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789478372.098251:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964372608:0@lo:501: 00000100:00100000:1.0:1789478372.098275:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964372736:0@lo:503: 00000100:00100000:1.0:1789478372.098315:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478372.098328:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34dfcb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789478372.098338:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964372736 00000100:00100000:1.0:1789478372.098341:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964372736 00000100:00100000:1.0:1789478372.098361:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789478372.098367:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964372736:12345-0@lo:503: 00000100:00100000:1.0:1789478372.098434:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964372736:12345-0@lo:503: Request processed in 67us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.098440:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789478372.098483:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964372736:0@lo:503: 00000100:00100000:2.0:1789478372.099160:0:8825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ece680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:8825:1876403964372864:0@lo:502: 00000100:00100000:2.0:1789478372.099193:0:8825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478372.099214:0:8825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc104fec00 going to sleep for 11 seconds 00000100:00100000:1.0:1789478372.099255:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964372864 00000100:00100000:1.0:1789478372.099259:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964372864 00000100:00100000:1.0:1789478372.099291:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789478372.099298:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+18:8825:x1876403964372864:12345-0@lo:502: 00000100:00100000:1.0:1789478372.099367:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+18:8825:x1876403964372864:12345-0@lo:502: Request processed in 69us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.099373:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789478372.099408:0:8825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ece680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:8825:1876403964372864:0@lo:502: 00000100:00100000:1.0:1789478372.099444:0:8825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b72d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:8825:1876403964372992:0@lo:502: 00000100:00100000:1.0:1789478372.099476:0:8825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478372.099494:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964372992 00000100:00100000:1.0:1789478372.099497:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964372992 00000100:00100000:1.0:1789478372.099518:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789478372.099524:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+18:8825:x1876403964372992:12345-0@lo:502: 00000100:00100000:1.0:1789478372.099785:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+18:8825:x1876403964372992:12345-0@lo:502: Request processed in 260us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.099791:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789478372.099819:0:8825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc1a16a180 going to sleep for 11 seconds 00000100:00100000:1.0:1789478372.099831:0:8825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b72d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:8825:1876403964372992:0@lo:502: 00000040:00080000:1.0:1789478372.099848:0:8825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000100:00100000:0.0:1789478372.100159:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1876403964371456:12345-0@lo:8: Request processed in 3740us (5312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478372.100168:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:2.0:1789478372.104146:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789478372.104250:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789478372.104274:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc029df400/0x8ebaae74e8215bdc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215bea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478372.104286:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc029df400/0x8ebaae74e8215bdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215bea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478372.104313:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789478372.104316:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ebc0501d800 from 5 10000000:01000000:2.0:1789478372.104319:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789478372.104386:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215bf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478372.104394:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215bf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478372.104417:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215bf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478372.104460:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964373120:0@lo:101: 00000100:00100000:2.0:1789478372.104797:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478372.104874:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc104fe3c0 going to sleep for 11 seconds 00010000:00080000:3.0:1789478372.104948:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb01b70000 x1876403964371456/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789478382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478372.104959:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789478372.104966:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789478372.104974:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789478372.104980:0:3644:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789478372.104983:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc34fac000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789478372.105001:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789478372.105006:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964371456:0@lo:8: 00000004:00080000:3.0:1789478372.105033:0:8823:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789478372.105105:0:8823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 201220510285ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789478372.105111:0:8823:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789478372.105873:0:8824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8824:1876403964373248:0@lo:700: 00000100:00100000:2.0:1789478372.105916:0:8824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478372.105953:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964373248 00000100:00100000:2.0:1789478372.105959:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964373248 00000100:00100000:2.0:1789478372.106004:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789478372.106013:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8824:x1876403964373248:12345-0@lo:700: 00000100:00100000:2.0:1789478372.106069:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8438:1876403964373376:0@lo:700: 00000100:00100000:2.0:1789478372.106106:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478372.106123:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc104feb40 going to sleep for 11 seconds 00000100:00080000:2.0:1789478372.106136:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789478372.106143:0:8824:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc104fed80 going to sleep for 11 seconds 00000100:00100000:3.0:1789478372.106349:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964373376 00000100:00100000:3.0:1789478372.106354:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964373376 00000100:00100000:3.0:1789478372.106426:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789478372.106434:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8438:x1876403964373376:12345-0@lo:700: 00000100:00100000:0.0:1789478372.108337:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964373120 00000100:00100000:0.0:1789478372.108348:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964373120 00000100:00100000:0.0:1789478372.108420:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789478372.108449:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964373120:12345-0@lo:101: 00010000:00010000:0.0:1789478372.108462:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478372.108494:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc35b66400/0x8ebaae74e8215bf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215bf1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478372.109229:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc35b66400/0x8ebaae74e8215bf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215bf1 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478372.109261:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc35b66400/0x8ebaae74e8215bf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215bf1 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478372.109287:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b66400, rc 0) 00000100:00100000:0.0:1789478372.109416:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+19:6514:x1876403964373120:12345-0@lo:101: Request processed in 988us (4619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478372.109424:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789478372.109980:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964373120:0@lo:101: 00010000:00010000:3.0:1789478372.110033:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215bf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215bf8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478372.110043:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215bf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215bf8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478372.110128:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c961880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964373504:0@lo:256: 00000100:00100000:3.0:1789478372.110204:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478372.110248:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964373504 00000100:00100000:1.0:1789478372.110254:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964373504 00000100:00100000:3.0:1789478372.110272:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc050450c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478372.110296:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789478372.110306:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+19:6514:x1876403964373504:12345-0@lo:256: 20000000:01000000:1.0:1789478372.110321:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789478372.110340:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789478372.110342:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789478372.111241:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+19:6514:x1876403964373504:12345-0@lo:256: Request processed in 933us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.111250:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789478372.111313:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c961880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964373504:0@lo:256: 10000000:01000000:0.0:1789478372.111442:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789478372.111457:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215bf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215bf8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478372.111481:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215bf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215bf8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478372.111489:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789478372.111518:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1789478372.111521:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789478372.111643:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66000/0x8ebaae74e8215bff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478372.111667:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66000/0x8ebaae74e8215bff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478372.111676:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66000/0x8ebaae74e8215bff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478372.111707:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964373632:0@lo:101: 00000100:00100000:0.0:1789478372.111772:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478372.111814:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05530cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478372.111848:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964373632 00000100:00100000:0.0:1789478372.111870:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964373632 00000100:00100000:0.0:1789478372.111929:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789478372.111952:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+19:6514:x1876403964373632:12345-0@lo:101: 00010000:00010000:0.0:1789478372.111962:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478372.111989:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc35b67000/0x8ebaae74e8215c06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215bff expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478372.112022:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc35b67000/0x8ebaae74e8215c06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215bff expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478372.112066:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc35b67000/0x8ebaae74e8215c06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215bff expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478372.112073:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b67000, rc 0) 00000100:00100000:0.0:1789478372.112122:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+20:6514:x1876403964373632:12345-0@lo:101: Request processed in 185us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478372.112128:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789478372.112195:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964373632:0@lo:101: 00010000:00010000:0.0:1789478372.112241:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66000/0x8ebaae74e8215bff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215c06 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478372.112276:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66000/0x8ebaae74e8215bff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215c06 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478372.112328:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964373760:0@lo:501: 00000100:00100000:0.0:1789478372.112396:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478372.112452:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05530cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478372.112467:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964373760 00000100:00100000:1.0:1789478372.112473:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964373760 00000100:00100000:1.0:1789478372.112500:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789478372.112507:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+20:6514:x1876403964373760:12345-0@lo:501: 00000100:00100000:1.0:1789478372.112626:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+20:6514:x1876403964373760:12345-0@lo:501: Request processed in 118us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.112633:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789478372.112932:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964373760:0@lo:501: 00000100:00100000:0.0:1789478372.112977:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964373888:0@lo:503: 00000100:00100000:0.0:1789478372.113075:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478372.113113:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05530cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478372.113144:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964373888 00000100:00100000:0.0:1789478372.113148:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964373888 00000100:00100000:0.0:1789478372.113190:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789478372.113216:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+20:6514:x1876403964373888:12345-0@lo:503: 00000100:00100000:0.0:1789478372.113357:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+20:6514:x1876403964373888:12345-0@lo:503: Request processed in 160us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478372.113370:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789478372.113449:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964373888:0@lo:503: 00000100:00100000:0.0:1789478372.114390:0:8826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:8826:1876403964374016:0@lo:502: 00000100:00100000:0.0:1789478372.114431:0:8826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478372.114461:0:8826:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05530e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789478372.114730:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964374016 00000100:00100000:1.0:1789478372.114736:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964374016 00000100:00100000:1.0:1789478372.114764:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789478372.114772:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+20:8826:x1876403964374016:12345-0@lo:502: 00000100:00100000:1.0:1789478372.114869:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+20:8826:x1876403964374016:12345-0@lo:502: Request processed in 98us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.114877:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789478372.115157:0:8826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:8826:1876403964374016:0@lo:502: 00000020:01000000:0.0:1789478372.115183:0:8826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789478372.115191:0:8826:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789478372.115198:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478372.115200:0:8826:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789478372.115204:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789478372.115207:0:8826:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:01000000:0.0:1789478372.115227:0:8826:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789478372.115230:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789478372.115243:0:8826:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8ebc3bd119b8) 00000020:00000080:0.0:1789478372.115262:0:8826:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1789478372.115267:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789478372.115352:0:8826:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789478372.115357:0:8826:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789478372.115364:0:8826:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ebaae74e8215c14 00010000:00080000:0.0:1789478372.115390:0:8826:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ebc3f68e000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.111@tcp at head 40000000:02000000:3.0:1789478372.115731:0:6524:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000004:00080000:2.0:1789478372.116943:0:7448:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00010000:0.0:1789478372.117494:0:8826:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:3.0:1789478372.131356:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8438:x1876403964373376:12345-0@lo:700: Request processed in 24897us (25223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478372.131375:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789478372.132389:0:8438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc40ecea00 x1876403964373376/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789478388 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478372.132405:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8438:1876403964373376:0@lo:700: 40000000:02000000:0.0:1789478372.132419:0:8438:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:1.0:1789478372.153928:0:8826:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789478372.153948:0:8826:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789478372.154138:0:8826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789478372.154337:0:8826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789478372.154450:0:8826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789478372.154531:0:8826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1789478372.165340:0:8827:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789478372.165361:0:8827:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789478372.166578:0:8826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789478372.166590:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789478372.166667:0:8826:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789478372.166690:0:8826:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8ebaae74e8215c1b 00000100:00080000:2.0:1789478372.166699:0:8826:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789478372.166709:0:8826:0:(import.c:625:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ebc3f68e000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1789478372.166743:0:8826:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebc40ecdf80 x1876403964374144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789478372.166765:0:8826:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789478372.166833:0:8826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789478372.166837:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478372.166839:0:8826:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789478372.166842:0:8826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789478372.166846:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478372.166847:0:8826:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789478372.166849:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789478372.166851:0:8826:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789478372.166877:0:8826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:8826:1876403964374272:0@lo:502: 00000100:00100000:2.0:1789478372.167133:0:8826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478372.167174:0:8826:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc104fe3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478372.167174:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964374272 00000100:00100000:0.0:1789478372.167182:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964374272 00000100:00100000:0.0:1789478372.167251:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789478372.167260:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+20:8826:x1876403964374272:12345-0@lo:502: 00000100:00100000:1.0:1789478372.167325:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964374144:0@lo:8: 00000100:00100000:1.0:1789478372.167374:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478372.167504:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+20:8826:x1876403964374272:12345-0@lo:502: Request processed in 244us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478372.167506:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964374144 00000100:00100000:2.0:1789478372.167512:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964374144 00000100:00100000:0.0:1789478372.167516:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789478372.167537:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789478372.167551:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1876403964374144:12345-0@lo:8: 00010000:00080000:2.0:1789478372.167573:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:2.0:1789478372.167618:0:8432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8ebaae74e8215c22 00002000:00100000:2.0:1789478372.167633:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ebb01b63000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789478372.167638:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789478372.167640:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789478372.167715:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789478372.167737:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8ebb01b62000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789478372.167774:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1876403964374144:12345-0@lo:8: Request processed in 222us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478372.167781:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789478372.169090:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc40ecdf80 x1876403964374144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789478382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478372.169116:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789478372.169125:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789478372.169134:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789478372.169138:0:3644:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789478372.169141:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc3f68e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789478372.169152:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789478372.169157:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964374144:0@lo:8: 00000100:00100000:1.0:1789478372.169197:0:8826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:8826:1876403964374272:0@lo:502: 00000020:01000000:1.0:1789478372.169224:0:8826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789478372.169231:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478372.169234:0:8826:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789478372.169238:0:8826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1789478372.169309:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1789478372.169327:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789478372.169336:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66000/0x8ebaae74e8215bff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215c06 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.169345:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66000/0x8ebaae74e8215bff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215c06 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478372.169355:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789478372.169358:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ebc08d93370 from 1 10000000:01000000:1.0:1789478372.169360:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789478372.169388:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc029dfa00/0x8ebaae74e8215c29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.169396:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc029dfa00/0x8ebaae74e8215c29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.169415:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc029dfa00/0x8ebaae74e8215c29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478372.169432:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964374400:0@lo:101: 00000100:00100000:1.0:1789478372.169475:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478372.169504:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40dfc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478372.169518:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964374400 00000100:00100000:1.0:1789478372.169523:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964374400 00000100:00100000:1.0:1789478372.169578:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789478372.169586:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+20:6514:x1876403964374400:12345-0@lo:101: 00010000:00010000:1.0:1789478372.169615:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478372.169628:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc42177800/0x8ebaae74e8215c30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215c29 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.169648:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc42177800/0x8ebaae74e8215c30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215c29 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.169659:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc42177800/0x8ebaae74e8215c30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215c29 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.169667:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc42177800, rc 0) 00000100:00100000:1.0:1789478372.169699:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964374400:12345-0@lo:101: Request processed in 114us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.169707:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789478372.169743:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964374400:0@lo:101: 00010000:00010000:1.0:1789478372.169758:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc029dfa00/0x8ebaae74e8215c29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215c30 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.169777:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc029dfa00/0x8ebaae74e8215c29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215c30 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478372.169824:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964374528:0@lo:501: 00000100:00100000:1.0:1789478372.169849:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478372.169868:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40dfc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478372.169880:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964374528 00000100:00100000:1.0:1789478372.169883:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964374528 00000100:00100000:1.0:1789478372.169903:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789478372.169909:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964374528:12345-0@lo:501: 00000100:00100000:1.0:1789478372.169973:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964374528:12345-0@lo:501: Request processed in 63us (123us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789478372.169980:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789478372.170008:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964374528:0@lo:501: 10000000:01000000:1.0:1789478372.170028:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789478372.170033:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc029dfa00/0x8ebaae74e8215c29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215c30 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478372.170041:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc029dfa00/0x8ebaae74e8215c29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215c30 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789478372.170757:0:8827:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789478372.171226:0:8827:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 201286631386ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789478372.171235:0:8827:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000001:00100000:1.0:1789478372.173688:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1789478372.174062:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8824:x1876403964373248:12345-0@lo:700: Request processed in 68035us (68129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478372.174074:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789478372.177351:0:8824:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc40ecfb80 x1876403964373248/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789478388 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478372.177369:0:8824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8824:1876403964373248:0@lo:700: 00000004:00080000:2.0:1789478372.179496:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1789478372.182526:0:8828:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789478372.182732:0:8828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8828:1876403964374784:0@lo:7: 00000100:00100000:0.0:1789478372.182801:0:8828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478372.182843:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964374784 00000100:00100000:0.0:1789478372.182849:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964374784 00000100:00100000:0.0:1789478372.182903:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789478372.182912:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8828:x1876403964374784:12345-0@lo:7: 00000100:00100000:2.0:1789478372.183941:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964374656:0@lo:13: 00000100:00100000:2.0:1789478372.183997:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789478372.184062:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789478372.184351:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964374656 00000100:00100000:2.0:1789478372.184359:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964374656 00000100:00100000:2.0:1789478372.184398:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789478372.184407:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876403964374656:12345-0@lo:13: 00002000:00000024:2.0:1789478372.184430:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923914752 avail 3692392448 00000100:00100000:2.0:1789478372.184474:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876403964374656:12345-0@lo:13: Request processed in 69us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478372.184488:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789478372.184526:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc34cb7800 x1876403964374656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478372.184545:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964374656:0@lo:13: 00000100:00100000:2.0:1789478372.185836:0:8828:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05530900 going to sleep for 11 seconds 00000100:00100000:2.0:1789478372.188925:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964374912:0@lo:13: 00000100:00100000:2.0:1789478372.188986:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478372.189034:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964374912 00000100:00100000:2.0:1789478372.189040:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964374912 00000100:00100000:2.0:1789478372.189090:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789478372.189099:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964374912:12345-0@lo:13: 00002000:00000024:2.0:1789478372.189134:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923914752 avail 3692392448 00000100:00100000:2.0:1789478372.189177:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964374912:12345-0@lo:13: Request processed in 78us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478372.189183:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789478372.189217:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc40ecf480 x1876403964374912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478372.189235:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964374912:0@lo:13: 00000004:00080000:2.0:1789478372.189253:0:8824:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789478372.189271:0:8824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8824:1876403964375040:0@lo:7: 00000100:00100000:2.0:1789478372.189295:0:8824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478372.189315:0:8824:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc104fe540 going to sleep for 11 seconds 00000100:00100000:1.0:1789478372.190372:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789478372.190381:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:0.0:1789478372.193731:0:8430:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1789478372.193740:0:8430:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789478372.193898:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8828:x1876403964374784:12345-0@lo:7: Request processed in 10983us (11094us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478372.193909:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789478372.193933:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964375040 00000100:00100000:0.0:1789478372.193940:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964375040 00000100:00100000:0.0:1789478372.193985:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789478372.193994:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8824:x1876403964375040:12345-0@lo:7: 00002000:00080000:0.0:1789478372.197819:0:8430:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1789478372.197831:0:8430:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789478372.197918:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8824:x1876403964375040:12345-0@lo:7: Request processed in 3922us (8618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478372.197929:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789478372.198180:0:8824:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc40ecf480 x1876403964375040/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789478388 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478372.198194:0:8824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8824:1876403964375040:0@lo:7: 00000004:00080000:3.0:1789478372.198206:0:8824:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789478372.198239:0:8824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c961f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8824:1876403964375168:0@lo:5: 00000100:00100000:3.0:1789478372.198270:0:8824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478372.198298:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964375168 00000100:00100000:3.0:1789478372.198303:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964375168 00000100:00100000:3.0:1789478372.198333:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789478372.198342:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8824:x1876403964375168:12345-0@lo:5: 00002000:00080000:3.0:1789478372.198362:0:8432:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1789478372.198386:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8824:x1876403964375168:12345-0@lo:5: Request processed in 47us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478372.198392:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789478372.198408:0:8824:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05045480 going to sleep for 11 seconds 00010000:00080000:3.0:1789478372.198420:0:8824:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc3c961f80 x1876403964375168/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789478388 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478372.198429:0:8824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c961f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8824:1876403964375168:0@lo:5: 00000004:00080000:3.0:1789478372.198445:0:8824:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789478372.198465:0:8824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c961f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8824:1876403964375296:0@lo:5: 00000100:00100000:3.0:1789478372.198484:0:8824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478372.198499:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964375296 00000100:00100000:3.0:1789478372.198507:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964375296 00000100:00100000:3.0:1789478372.198523:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789478372.198528:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8824:x1876403964375296:12345-0@lo:5: 00002000:00080000:3.0:1789478372.198544:0:8432:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1789478372.200003:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8824:x1876403964375296:12345-0@lo:5: Request processed in 1469us (1512us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789478372.200014:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789478372.200105:0:8824:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05045480 going to sleep for 11 seconds 00010000:00080000:3.0:1789478372.200127:0:8824:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc3c961f80 x1876403964375296/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789478388 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478372.200139:0:8824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c961f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8824:1876403964375296:0@lo:5: 00000004:00080000:3.0:1789478372.200155:0:8824:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1789478372.200186:0:8824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c963480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8824:1876403964375424:0@lo:900: 00000100:00100000:3.0:1789478372.200213:0:8824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478372.200231:0:8824:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05045480 going to sleep for 11 seconds 00010000:00080000:2.0:1789478372.200462:0:8828:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc34cb7480 x1876403964374784/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789478388 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478372.200473:0:8828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8828:1876403964374784:0@lo:7: 00000004:00080000:2.0:1789478372.200487:0:8828:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789478372.200509:0:8828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8828:1876403964375552:0@lo:5: 00000100:00100000:2.0:1789478372.200543:0:8828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478372.200563:0:8828:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc104fe0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478372.200705:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964375552 00000100:00100000:3.0:1789478372.200711:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964375552 00000100:00100000:3.0:1789478372.200737:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789478372.200746:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8828:x1876403964375552:12345-0@lo:5: 00002000:00080000:3.0:1789478372.200763:0:8432:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789478372.200766:0:8432:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789478372.201886:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964375424 00000100:00100000:0.0:1789478372.201894:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964375424 00000100:00100000:0.0:1789478372.202175:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789478372.202185:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8824:x1876403964375424:12345-0@lo:900: 00000100:00100000:0.0:1789478372.202256:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8824:x1876403964375424:12345-0@lo:900: Request processed in 72us (2041us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478372.202263:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789478372.202320:0:8824:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc3c963480 x1876403964375424/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789478388 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478372.202342:0:8824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c963480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8824:1876403964375424:0@lo:900: 00000001:00080000:2.0:1789478372.205527:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:2.0:1789478372.205710:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1789478372.205719:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789478372.205881:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8828:x1876403964375552:12345-0@lo:5: Request processed in 5133us (5333us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789478372.205891:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789478372.207794:0:8828:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc40ecdc00 x1876403964375552/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789478388 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478372.207808:0:8828:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789478372.207814:0:8828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8828:1876403964375552:0@lo:5: 00000004:00080000:0.0:1789478372.207827:0:8828:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789478372.207874:0:8828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8828:1876403964375680:0@lo:700: 00000100:00100000:0.0:1789478372.207919:0:8828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478372.207953:0:8828:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08d12180 going to sleep for 11 seconds 00000100:00100000:1.0:1789478372.208042:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964375680 00000100:00100000:1.0:1789478372.208048:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964375680 00000100:00100000:1.0:1789478372.208107:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789478372.208118:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8828:x1876403964375680:12345-0@lo:700: 00000100:00100000:1.0:1789478372.219008:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8828:x1876403964375680:12345-0@lo:700: Request processed in 10883us (11079us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478372.219022:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789478372.219121:0:8828:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc34cb6300 x1876403964375680/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789478388 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478372.219137:0:8828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8828:1876403964375680:0@lo:700: 00000004:02000040:3.0:1789478372.221379:0:8828:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1789478372.230234:0:8828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c961180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8828:1876403964375808:0@lo:5: 00000100:00100000:3.0:1789478372.230295:0:8828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478372.230367:0:8828:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05045840 going to sleep for 11 seconds 00000100:00100000:0.0:1789478372.231042:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964375808 00000100:00100000:0.0:1789478372.231062:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964375808 00000100:00100000:2.0:1789478372.231175:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789478372.231188:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8828:x1876403964375808:12345-0@lo:5: 00002000:00080000:2.0:1789478372.236944:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789478372.236963:0:8431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1789478372.239820:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8828:x1876403964375808:12345-0@lo:5: Request processed in 8629us (9518us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789478372.239834:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789478372.240107:0:8828:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc3c961180 x1876403964375808/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789478388 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478372.240124:0:8828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c961180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8828:1876403964375808:0@lo:5: 00000004:00080000:3.0:1789478372.240149:0:8828:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000020:00000004:2.0:1789478372.558376:0:8860:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789478372.558802:0:8860:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789478372.900737:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789478373.244478:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:0.0:1789478373.924861:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478374.116799:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789478374.116821:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964375936:0@lo:41: 00000100:00100000:3.0:1789478374.116879:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478374.117114:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964375936 00000100:00100000:2.0:1789478374.117122:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964375936 00000100:00100000:2.0:1789478374.117174:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789478374.117183:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964375936:12345-0@lo:41: 00000004:00000024:2.0:1789478374.117213:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789478374.117263:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964375936:12345-0@lo:41: Request processed in 81us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478374.117271:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789478374.117417:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964375936:0@lo:41: 00000100:00100000:1.0:1789478374.117558:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789478374.117568:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964376064:0@lo:41: 00000100:00100000:1.0:1789478374.117615:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478374.117752:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964376064 00000100:00100000:2.0:1789478374.117757:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964376064 00000100:00100000:2.0:1789478374.117789:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789478374.117796:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964376064:12345-0@lo:41: 00000004:00000024:2.0:1789478374.117825:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1789478374.117863:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964376064:12345-0@lo:41: Request processed in 67us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478374.117869:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789478374.117963:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964376064:0@lo:41: 00010000:00010000:3.0:1789478374.948766:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789478375.277340:0:8962:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789478375.279389:0:8962:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789478375.974518:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789478376.403191:0:9010:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789478376.403200:0:9010:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1789478377.000318:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478377.188912:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964376448:0@lo:400: 00000100:00100000:1.0:1789478377.188965:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478377.189011:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964376960:0@lo:400: 00000100:00100000:1.0:1789478377.189043:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478377.189064:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789478377.189068:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964376576:0@lo:400: 00000100:00100000:1.0:1789478377.189085:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478377.189101:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964377088:0@lo:400: 00000100:00100000:1.0:1789478377.189120:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478377.189143:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964376960 00000100:00100000:1.0:1789478377.189148:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964376960 00000100:00100000:1.0:1789478377.189189:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789478377.189202:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964376960:12345-0@lo:400: 00000100:00100000:1.0:1789478377.189240:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964376960:12345-0@lo:400: Request processed in 39us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478377.189246:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789478377.189265:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964377088 00000100:00100000:1.0:1789478377.189268:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964377088 00000100:00100000:1.0:1789478377.189286:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789478377.189291:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c897b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964377088:12345-0@lo:400: 00000100:00100000:1.0:1789478377.189314:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c897b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964377088:12345-0@lo:400: Request processed in 23us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478377.189319:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789478377.189346:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc3c894e00 x1876403964377088/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478377.189356:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789478377.189367:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964377088:0@lo:400: 00010000:00080000:1.0:1789478377.189376:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc3c896300 x1876403964376960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478377.189384:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964376960:0@lo:400: 00000100:00100000:2.0:1789478377.189448:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964376192:0@lo:400: 00000100:00100000:2.0:1789478377.189476:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478377.189510:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964376704:0@lo:400: 00000100:00100000:2.0:1789478377.189536:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478377.189555:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964377216:0@lo:400: 00000100:00100000:2.0:1789478377.189586:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478377.189622:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789478377.189627:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964376320:0@lo:400: 00000100:00100000:2.0:1789478377.189647:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478377.189668:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964376832:0@lo:400: 00000100:00100000:2.0:1789478377.189686:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478377.189712:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964376448 00000100:00100000:2.0:1789478377.189721:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964376448 00000100:00100000:2.0:1789478377.189746:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964376576 00000100:00100000:2.0:1789478377.189749:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964376576 00000100:00100000:2.0:1789478377.189761:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789478377.189767:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964376448:12345-0@lo:400: 00000100:00100000:2.0:1789478377.189804:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964376448:12345-0@lo:400: Request processed in 37us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478377.189809:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789478377.189821:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789478377.189826:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964376576:12345-0@lo:400: 00000100:00100000:2.0:1789478377.189860:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964376576:12345-0@lo:400: Request processed in 34us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478377.189865:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1789478377.189880:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789478377.189889:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789478377.189899:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964376704 00000100:00100000:2.0:1789478377.189902:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964376704 00000100:00100000:2.0:1789478377.189915:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964376320 00000100:00100000:2.0:1789478377.189917:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964376320 00000100:00100000:2.0:1789478377.189925:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964376832 00000100:00100000:2.0:1789478377.189926:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964376832 00000100:00100000:2.0:1789478377.189942:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789478377.189948:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964376704:12345-0@lo:400: 00000100:00100000:2.0:1789478377.189977:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964376704:12345-0@lo:400: Request processed in 29us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478377.189981:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789478377.189991:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789478377.189996:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964376320:12345-0@lo:400: 00000100:00100000:2.0:1789478377.190017:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964376320:12345-0@lo:400: Request processed in 21us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478377.190021:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789478377.190044:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789478377.190050:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964376832:12345-0@lo:400: 00000100:00100000:2.0:1789478377.190072:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964376832:12345-0@lo:400: Request processed in 23us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478377.190077:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1789478377.190093:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789478377.190110:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb01b73800 x1876403964376320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478377.190126:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964376320:0@lo:400: 00010000:00080000:2.0:1789478377.190136:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc3c896d80 x1876403964376832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478377.190143:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964376832:0@lo:400: 00010000:00080000:2.0:1789478377.190150:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb01b71180 x1876403964376704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478377.190157:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964376704:0@lo:400: 00000100:00100000:2.0:1789478377.190181:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964376576:0@lo:400: 00000100:00100000:2.0:1789478377.190191:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964376448:0@lo:400: 00000100:00100000:3.0:1789478377.190742:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964377216 00000100:00100000:3.0:1789478377.190747:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964377216 00000100:00100000:3.0:1789478377.190775:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789478377.190781:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964377216:12345-0@lo:400: 00000100:00100000:3.0:1789478377.190813:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964377216:12345-0@lo:400: Request processed in 33us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478377.190819:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789478377.190875:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964377344:0@lo:13: 00000100:00100000:0.0:1789478377.190908:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478377.190985:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964377344 00000100:00100000:3.0:1789478377.190990:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964377344 00000100:00100000:1.0:1789478377.191086:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964376192 00000100:00100000:1.0:1789478377.191091:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964376192 00000100:00100000:1.0:1789478377.191119:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789478377.191126:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+21:3645:x1876403964376192:12345-0@lo:400: 00000100:00100000:1.0:1789478377.191159:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+21:3645:x1876403964376192:12345-0@lo:400: Request processed in 35us (1682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478377.191165:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1789478377.191248:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789478377.191269:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964376192:0@lo:400: 00010000:00080000:2.0:1789478377.191280:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc3c894a80 x1876403964377216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478377.191289:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1789478377.191299:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964377216:0@lo:400: 00000100:00100000:3.0:1789478377.191351:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789478377.191359:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964377344:12345-0@lo:13: 00002000:00000024:3.0:1789478377.191382:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478377.191424:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964377344:12345-0@lo:13: Request processed in 66us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478377.191430:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789478377.191482:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc3c960e00 x1876403964377344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478377.191504:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964377344:0@lo:13: 00000100:00100000:1.0:1789478377.708747:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789478377.708771:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964377472:0@lo:13: 00000100:00100000:1.0:1789478377.708830:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478377.708908:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964377472 00000100:00100000:1.0:1789478377.708916:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964377472 00000100:00100000:1.0:1789478377.708957:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789478377.708966:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964377472:12345-0@lo:13: 00002000:00000024:1.0:1789478377.708984:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789478377.709041:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964377472:12345-0@lo:13: Request processed in 75us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478377.709047:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789478377.709084:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc3c896300 x1876403964377472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478377.709112:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964377472:0@lo:13: 00010000:00010000:1.0:1789478378.023018:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478379.047238:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478379.239720:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789478379.239741:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964377600:0@lo:41: 00000100:00100000:0.0:1789478379.239796:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478379.239842:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964377600 00000100:00100000:0.0:1789478379.239848:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964377600 00000100:00100000:0.0:1789478379.239884:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789478379.239891:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964377600:12345-0@lo:41: 00000004:00000024:0.0:1789478379.239916:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789478379.239949:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964377600:12345-0@lo:41: Request processed in 59us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478379.239956:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789478379.239990:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964377600:0@lo:41: 00000100:00100000:0.0:1789478379.240438:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789478379.240447:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964377728:0@lo:41: 00000100:00100000:0.0:1789478379.240472:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478379.240494:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964377728 00000100:00100000:0.0:1789478379.240498:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964377728 00000100:00100000:0.0:1789478379.240577:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789478379.240585:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964377728:12345-0@lo:41: 00000004:00000024:0.0:1789478379.240804:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789478379.240836:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964377728:12345-0@lo:41: Request processed in 253us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478379.240843:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789478379.240867:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964377728:0@lo:41: 00010000:00010000:1.0:1789478380.074962:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478381.093806:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478382.116724:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478382.308926:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964378112:0@lo:400: 00000100:00100000:3.0:1789478382.308988:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478382.309051:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876403964378624:0@lo:400: 00000100:00100000:3.0:1789478382.309077:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478382.309100:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789478382.309106:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876403964377984:0@lo:400: 00000100:00100000:3.0:1789478382.309147:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478382.309166:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876403964378496:0@lo:400: 00000100:00100000:3.0:1789478382.309187:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478382.309230:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964378112 00000100:00100000:3.0:1789478382.309236:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964378112 00000100:00100000:3.0:1789478382.309274:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789478382.309281:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964378112:12345-0@lo:400: 00000100:00100000:3.0:1789478382.309324:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964378112:12345-0@lo:400: Request processed in 43us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478382.309331:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789478382.309363:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964378624 00000100:00100000:3.0:1789478382.309366:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964378624 00000100:00100000:3.0:1789478382.309393:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964377984 00000100:00100000:3.0:1789478382.309396:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964377984 00000100:00100000:3.0:1789478382.309407:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964378496 00000100:00100000:3.0:1789478382.309409:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964378496 00000100:00100000:3.0:1789478382.309435:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789478382.309441:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876403964378624:12345-0@lo:400: 00000100:00100000:3.0:1789478382.309485:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876403964378624:12345-0@lo:400: Request processed in 44us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478382.309491:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789478382.309501:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789478382.309626:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964378240:0@lo:400: 00000100:00100000:1.0:1789478382.309656:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478382.309681:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964378752:0@lo:400: 00000100:00100000:1.0:1789478382.309702:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478382.309717:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789478382.309722:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964377856:0@lo:400: 00000100:00100000:1.0:1789478382.309742:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478382.309759:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964378368:0@lo:400: 00000100:00100000:1.0:1789478382.309776:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478382.309795:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964378880:0@lo:400: 00000100:00100000:1.0:1789478382.309816:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478382.309841:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964378240 00000100:00100000:1.0:1789478382.309844:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964378240 00000100:00100000:1.0:1789478382.309869:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789478382.309875:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964378240:12345-0@lo:400: 00000100:00100000:1.0:1789478382.309907:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964378240:12345-0@lo:400: Request processed in 32us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478382.309913:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789478382.309930:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964378752 00000100:00100000:1.0:1789478382.309933:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964378752 00000100:00100000:1.0:1789478382.309956:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964378880 00000100:00100000:1.0:1789478382.309959:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964378880 00000100:00100000:1.0:1789478382.309978:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789478382.309984:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964378752:12345-0@lo:400: 00000100:00100000:1.0:1789478382.310027:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964378752:12345-0@lo:400: Request processed in 43us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478382.310033:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789478382.310043:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789478382.310049:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c895880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964378880:12345-0@lo:400: 00000100:00100000:1.0:1789478382.310073:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c895880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964378880:12345-0@lo:400: Request processed in 24us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478382.310078:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789478382.310095:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964377856 00000100:00100000:1.0:1789478382.310098:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964377856 00000100:00100000:1.0:1789478382.310120:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789478382.310126:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+21:3645:x1876403964377856:12345-0@lo:400: 00000100:00100000:1.0:1789478382.310152:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+21:3645:x1876403964377856:12345-0@lo:400: Request processed in 27us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478382.310164:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789478382.310212:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964377856:0@lo:400: 00010000:00080000:1.0:1789478382.310225:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc3c962300 x1876403964378880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478382.310237:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964378880:0@lo:400: 00000100:00100000:1.0:1789478382.310245:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964378240:0@lo:400: 00010000:00080000:1.0:1789478382.310254:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc3c961f80 x1876403964378752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478382.310263:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964378752:0@lo:400: 00000100:00100000:3.0:1789478382.310411:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876403964377984:12345-0@lo:400: 00000100:00100000:3.0:1789478382.310442:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876403964377984:12345-0@lo:400: Request processed in 34us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478382.310448:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789478382.310459:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964378368 00000100:00100000:3.0:1789478382.310462:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964378368 00000100:00100000:3.0:1789478382.310477:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789478382.310483:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876403964378496:12345-0@lo:400: 00000100:00100000:3.0:1789478382.310714:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876403964378496:12345-0@lo:400: Request processed in 230us (1525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478382.310720:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789478382.310733:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789478382.310739:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964378368:12345-0@lo:400: 00000100:00100000:3.0:1789478382.310766:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964378368:12345-0@lo:400: Request processed in 28us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478382.310771:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1789478382.310794:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789478382.310797:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789478382.310800:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789478382.310820:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc3c960380 x1876403964377984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478382.310842:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876403964377984:0@lo:400: 00010000:00080000:3.0:1789478382.310854:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc3c960e00 x1876403964378496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478382.310862:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876403964378496:0@lo:400: 00000100:00100000:3.0:1789478382.310871:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964378112:0@lo:400: 00010000:00080000:3.0:1789478382.310880:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc3c961180 x1876403964378624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478382.310887:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876403964378624:0@lo:400: 00000100:00100000:3.0:1789478382.311206:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789478382.311216:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964379008:0@lo:13: 00000100:00100000:3.0:1789478382.311245:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478382.311365:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964379008 00000100:00100000:0.0:1789478382.311371:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964379008 00000100:00100000:0.0:1789478382.311411:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789478382.311419:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964379008:12345-0@lo:13: 00002000:00000024:0.0:1789478382.311441:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478382.311496:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964379008:12345-0@lo:13: Request processed in 78us (250us total) trans 0 rc 0/0 00010000:00080000:2.0:1789478382.311633:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc34cb4a80 x1876403964379008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478382.311646:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964379008:0@lo:13: 00000100:00100000:0.0:1789478382.311900:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789478382.311970:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc3c963b80 x1876403964378368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478382.311980:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964378368:0@lo:400: 00000100:00100000:0.0:1789478382.829685:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789478382.829712:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964379136:0@lo:13: 00000100:00100000:0.0:1789478382.829889:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478382.831229:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964379136 00000100:00100000:3.0:1789478382.831239:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964379136 00000100:00100000:3.0:1789478382.831300:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789478382.831311:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964379136:12345-0@lo:13: 00002000:00000024:3.0:1789478382.831334:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478382.831406:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964379136:12345-0@lo:13: Request processed in 96us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478382.831413:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789478382.832201:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc40f61c00 x1876403964379136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478382.832225:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964379136:0@lo:13: 00010000:00010000:1.0:1789478383.142214:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478384.168149:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478384.356792:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964379264:0@lo:41: 00000100:00100000:1.0:1789478384.356874:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478384.356944:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964379392:0@lo:41: 00000100:00100000:3.0:1789478384.356974:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478384.361202:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964379264 00000100:00100000:1.0:1789478384.361217:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964379264 00000100:00100000:1.0:1789478384.361262:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964379392 00000100:00100000:1.0:1789478384.361266:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964379392 00000100:00100000:1.0:1789478384.361287:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789478384.361297:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964379264:12345-0@lo:41: 00000004:00000024:1.0:1789478384.361330:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789478384.361413:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964379264:12345-0@lo:41: Request processed in 117us (4538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478384.361432:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789478384.361451:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789478384.361457:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964379392:12345-0@lo:41: 00000004:00000024:1.0:1789478384.361473:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789478384.361510:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964379392:12345-0@lo:41: Request processed in 53us (4535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478384.361516:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789478384.361580:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964379264:0@lo:41: 00000100:00100000:0.0:1789478384.361661:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964379392:0@lo:41: 00010000:00010000:2.0:1789478385.190093:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478386.215308:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789478386.356821:0:9509:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789478386.356825:0:9509:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789478386.356831:0:9509:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789478386.356953:0:9509:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ebc3f6c1800 00000020:01000004:3.0:1789478386.356968:0:9509:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789478386.356990:0:9509:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789478386.357002:0:9509:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8ebb0229cd28) 00000020:00000080:3.0:1789478386.357018:0:9509:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789478386.405869:0:9509:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789478386.405916:0:9509:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1789478386.450820:0:9509:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789478386.452181:0:9509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789478386.452196:0:9509:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789478386.452207:0:9509:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8ebaae74e8215c3e 00000020:01000004:2.0:1789478386.452214:0:9509:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789478386.452236:0:9509:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.111@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789478386.452240:0:9509:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789478386.452245:0:9509:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789478386.452276:0:9509:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789478386.452280:0:9509:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.111@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789478386.479388:0:9509:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789478386.479424:0:9509:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.111@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789478386.479428:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789478386.479429:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789478386.479431:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789478386.479431:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789478386.479433:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789478386.479434:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789478386.479436:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789478386.479437:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789478386.479438:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789478386.479440:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789478386.479441:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789478386.481745:0:9509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789478386.481753:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789478386.481755:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789478386.481757:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789478386.481758:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789478386.481759:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789478386.481760:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789478386.481762:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789478386.481763:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789478386.481765:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789478386.481766:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789478386.481767:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789478386.482718:0:9509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789478386.482740:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964379520:0@lo:253: 00000100:00100000:3.0:1789478386.482817:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478386.482870:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08f21180 going to sleep for 11 seconds 00000100:00100000:0.0:1789478386.483687:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964379520 00000100:00100000:0.0:1789478386.483695:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964379520 00000100:00100000:0.0:1789478386.483741:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789478386.483749:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+21:9509:x1876403964379520:12345-0@lo:253: 20000000:01000000:0.0:1789478386.483783:0:6511:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789478386.483787:0:6511:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789478386.483792:0:6511:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789478386.483794:0:6511:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789478386.484084:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789478386.484210:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1789478386.484224:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789478386.484241:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1789478386.484248:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789478386.484261:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1789478386.484277:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1789478386.484369:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1789478386.484384:0:6511:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.111@tcp 20000000:01000000:0.0:1789478386.484386:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.111@tcp (null) (null) (null) 00000040:00080000:0.0:1789478386.484401:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1789478386.484408:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789478386.484422:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1789478386.484428:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.111@tcp (null) (null) 00000040:00080000:0.0:1789478386.484441:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1789478386.484447:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789478386.484460:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1789478386.484475:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1789478386.485859:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1789478386.485878:0:6511:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.111@tcp 20000000:01000000:0.0:1789478386.485880:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.111@tcp (null) (null) (null) 00000040:00080000:0.0:1789478386.485894:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1789478386.485900:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789478386.485911:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1789478386.485915:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.206.111@tcp (null) (null) 00000040:00080000:0.0:1789478386.485926:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1789478386.485932:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789478386.485943:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1789478386.485955:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1789478386.486372:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1789478386.486384:0:6511:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.111@tcp 20000000:01000000:0.0:1789478386.486386:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.111@tcp (null) (null) (null) 00000040:00080000:0.0:1789478386.486401:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1789478386.486407:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789478386.486419:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1789478386.486424:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.111@tcp (null) (null) 00000040:00080000:0.0:1789478386.486436:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1789478386.486468:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789478386.487430:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1789478386.487577:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1789478386.487802:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789478386.487806:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789478386.487810:0:6511:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789478386.487858:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789478386.487860:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789478386.488284:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1789478386.488306:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1789478386.488321:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1789478386.489135:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1789478386.489161:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1789478386.489174:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:0.0:1789478386.489184:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789478386.489186:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789478386.489477:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1789478386.489514:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1789478386.489526:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789478386.489777:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789478386.489800:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1789478386.489816:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1789478386.489827:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789478386.489829:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789478386.492249:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1789478386.492285:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1789478386.492322:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1789478386.492936:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1789478386.492961:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1789478386.492975:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1789478386.492999:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789478386.493002:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789478386.493303:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1789478386.493429:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1789478386.493458:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1789478386.493472:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1789478386.493489:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789478386.493491:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789478386.493903:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1789478386.493920:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1789478386.493932:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1789478386.494058:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1789478386.494075:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1789478386.494086:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:1.0:1789478386.494097:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789478386.494113:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ebc42176000/0x8ebaae74e8215c45 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.494129:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc00030c00/0x8ebaae74e8215b3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215b34 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.494136:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc00031000/0x8ebaae74e8215b65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215b5e expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.494152:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc35b67e00/0x8ebaae74e8215ba4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215b9d expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.494158:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc029df000/0x8ebaae74e8215bc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215bb9 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.494164:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc029dee00/0x8ebaae74e8215bea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215bdc expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.494169:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc35b67000/0x8ebaae74e8215c06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215bff expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.494175:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc42177800/0x8ebaae74e8215c30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215c29 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.494181:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ebc42176000/0x8ebaae74e8215c45 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.494213:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc42177800/0x8ebaae74e8215c30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215c29 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.494227:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc42177800/0x8ebaae74e8215c30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215c29 expref: 21 pid: 6510 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478386.494241:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c895c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1876403964379648:0@lo:104: 00000100:00100000:1.0:1789478386.494294:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789478386.494360:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc35b67000/0x8ebaae74e8215c06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215bff expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.494374:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc35b67000/0x8ebaae74e8215c06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215bff expref: 21 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478386.494389:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c897480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1876403964379776:0@lo:104: 00000100:00100000:1.0:1789478386.494412:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789478386.494456:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc029dee00/0x8ebaae74e8215bea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215bdc expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.494464:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc029dee00/0x8ebaae74e8215bea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215bdc expref: 21 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478386.494471:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c895180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1876403964379904:0@lo:104: 00000100:00100000:1.0:1789478386.494680:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789478386.494705:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc029df000/0x8ebaae74e8215bc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215bb9 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.494713:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc029df000/0x8ebaae74e8215bc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215bb9 expref: 21 pid: 6510 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478386.494721:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c894a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1876403964380032:0@lo:104: 00000100:00100000:1.0:1789478386.494753:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789478386.494771:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc35b67e00/0x8ebaae74e8215ba4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215b9d expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.494778:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc35b67e00/0x8ebaae74e8215ba4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215b9d expref: 21 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478386.494787:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c963b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1876403964380160:0@lo:104: 00000100:00100000:1.0:1789478386.494805:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789478386.494820:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc00031000/0x8ebaae74e8215b65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215b5e expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.494837:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc00031000/0x8ebaae74e8215b65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215b5e expref: 21 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478386.494846:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c962680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1876403964380288:0@lo:104: 00000100:00100000:1.0:1789478386.494868:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789478386.494884:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc00030c00/0x8ebaae74e8215b3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215b34 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.494892:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc00030c00/0x8ebaae74e8215b3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215b34 expref: 21 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478386.494899:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c960e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1876403964380416:0@lo:104: 00000100:00100000:1.0:1789478386.494915:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34de1240 going to sleep for 11 seconds 00000100:00100000:0.0:1789478386.494990:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789478386.495007:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478386.495018:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964379648 00000100:00100000:0.0:1789478386.495023:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964379648 00000100:00100000:0.0:1789478386.495052:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964379776 00000100:00100000:0.0:1789478386.495055:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964379776 00000100:00100000:0.0:1789478386.495075:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964379904 00000100:00100000:0.0:1789478386.495078:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964379904 00000100:00100000:0.0:1789478386.495086:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964380032 00000100:00100000:0.0:1789478386.495088:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964380032 00000100:00100000:0.0:1789478386.495095:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964380160 00000100:00100000:0.0:1789478386.495097:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964380160 00000100:00100000:0.0:1789478386.495105:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964380288 00000100:00100000:0.0:1789478386.495107:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964380288 00000100:00100000:0.0:1789478386.495115:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964380416 00000100:00100000:0.0:1789478386.495118:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964380416 00000100:00100000:0.0:1789478386.495129:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789478386.495137:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c897100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+9:6511:x1876403964379648:12345-0@lo:104: 00010000:00010000:0.0:1789478386.495147:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc029dfa00/0x8ebaae74e8215c29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215c30 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.495203:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789478386.495208:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c897100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+9:6511:x1876403964379648:12345-0@lo:104: Request processed in 72us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478386.495215:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789478386.495230:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789478386.495236:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c894700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+8:6511:x1876403964379776:12345-0@lo:104: 00010000:00010000:0.0:1789478386.495243:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66000/0x8ebaae74e8215bff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215c06 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.495276:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789478386.495281:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c894700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+8:6511:x1876403964379776:12345-0@lo:104: Request processed in 46us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478386.495286:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789478386.495298:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789478386.495304:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c897800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+7:6511:x1876403964379904:12345-0@lo:104: 00010000:00010000:0.0:1789478386.495316:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc029df400/0x8ebaae74e8215bdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215bea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.495349:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789478386.495354:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c897800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+7:6511:x1876403964379904:12345-0@lo:104: Request processed in 51us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478386.495360:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789478386.495373:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789478386.495379:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c896d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+6:6511:x1876403964380032:12345-0@lo:104: 00010000:00010000:0.0:1789478386.495386:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc029df600/0x8ebaae74e8215bb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215bc0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.495411:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789478386.495416:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c896d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+6:6511:x1876403964380032:12345-0@lo:104: Request processed in 38us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478386.495421:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789478386.495432:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789478386.495438:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c961180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+5:6511:x1876403964380160:12345-0@lo:104: 00010000:00010000:0.0:1789478386.495457:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc029df800/0x8ebaae74e8215b9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215ba4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.495561:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1789478386.495566:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c961180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+5:6511:x1876403964380160:12345-0@lo:104: Request processed in 128us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478386.495572:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789478386.495585:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789478386.495590:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3d7c4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+4:6511:x1876403964380288:12345-0@lo:104: 00000100:00100000:1.0:1789478386.495740:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c895c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1876403964379648:0@lo:104: 00000100:00100000:1.0:1789478386.495749:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c897480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1876403964379776:0@lo:104: 00000100:00100000:1.0:1789478386.495756:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c895180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1876403964379904:0@lo:104: 00000100:00100000:1.0:1789478386.495762:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c894a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1876403964380032:0@lo:104: 00000100:00100000:1.0:1789478386.495768:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c963b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1876403964380160:0@lo:104: 00010000:00010000:0.0:1789478386.495825:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc029de400/0x8ebaae74e8215b5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215b65 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.495860:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1789478386.495865:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3d7c4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+4:6511:x1876403964380288:12345-0@lo:104: Request processed in 275us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478386.495871:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789478386.495899:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789478386.495906:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+3:6511:x1876403964380416:12345-0@lo:104: 00010000:00010000:0.0:1789478386.495912:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc029de600/0x8ebaae74e8215b34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215b3b expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.495937:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1789478386.495942:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+3:6511:x1876403964380416:12345-0@lo:104: Request processed in 37us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478386.495947:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1789478386.495963:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1789478386.495967:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc029dfa00/0x8ebaae74e8215c29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215c30 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.495974:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029dfa00 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478386.495989:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc029dfa00/0x8ebaae74e8215c29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215c30 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.495997:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc029dfa00/0x8ebaae74e8215c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215c30 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478386.496003:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc029dfa00/0x8ebaae74e8215c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215c30 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478386.496014:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789478386.496047:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc029dfa00/0x8ebaae74e8215c29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215c30 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496053:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478386.496072:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc029dfa00/0x8ebaae74e8215c29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215c30 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496079:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc029dfa00/0x8ebaae74e8215c29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215c30 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496089:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789478386.496092:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66000/0x8ebaae74e8215bff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215c06 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496096:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b66000 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478386.496099:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66000/0x8ebaae74e8215bff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215c06 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496105:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66000/0x8ebaae74e8215bff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215c06 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478386.496111:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66000/0x8ebaae74e8215bff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215c06 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478386.496116:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789478386.496127:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66000/0x8ebaae74e8215bff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215c06 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496132:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478386.496144:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66000/0x8ebaae74e8215bff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215c06 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496150:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66000/0x8ebaae74e8215bff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215c06 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496158:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789478386.496161:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc029df400/0x8ebaae74e8215bdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215bea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496166:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029df400 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478386.496168:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc029df400/0x8ebaae74e8215bdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215bea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496175:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc029df400/0x8ebaae74e8215bdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215bea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478386.496181:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc029df400/0x8ebaae74e8215bdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215bea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478386.496186:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789478386.496198:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc029df400/0x8ebaae74e8215bdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215bea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496203:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478386.496216:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc029df400/0x8ebaae74e8215bdc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215bea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496223:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc029df400/0x8ebaae74e8215bdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215bea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496231:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789478386.496239:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc029df600/0x8ebaae74e8215bb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215bc0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496246:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029df600 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478386.496248:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc029df600/0x8ebaae74e8215bb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215bc0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496254:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc029df600/0x8ebaae74e8215bb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215bc0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478386.496260:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc029df600/0x8ebaae74e8215bb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215bc0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478386.496265:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789478386.496278:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc029df600/0x8ebaae74e8215bb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215bc0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496284:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478386.496288:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc029df600/0x8ebaae74e8215bb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215bc0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496294:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc029df600/0x8ebaae74e8215bb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215bc0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496302:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789478386.496305:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc029df800/0x8ebaae74e8215b9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215ba4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496311:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029df800 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478386.496314:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc029df800/0x8ebaae74e8215b9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215ba4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496330:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc029df800/0x8ebaae74e8215b9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215ba4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478386.496336:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc029df800/0x8ebaae74e8215b9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215ba4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478386.496341:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789478386.496354:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc029df800/0x8ebaae74e8215b9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215ba4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496360:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478386.496364:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc029df800/0x8ebaae74e8215b9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215ba4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496370:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc029df800/0x8ebaae74e8215b9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215ba4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496378:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789478386.496381:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc029de400/0x8ebaae74e8215b5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215b65 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496387:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029de400 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478386.496389:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc029de400/0x8ebaae74e8215b5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215b65 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496395:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc029de400/0x8ebaae74e8215b5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215b65 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478386.496400:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc029de400/0x8ebaae74e8215b5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215b65 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478386.496410:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789478386.496423:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc029de400/0x8ebaae74e8215b5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215b65 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496428:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478386.496432:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc029de400/0x8ebaae74e8215b5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215b65 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496437:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc029de400/0x8ebaae74e8215b5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215b65 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496446:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789478386.496448:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc029de600/0x8ebaae74e8215b34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215b3b expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496453:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029de600 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478386.496455:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc029de600/0x8ebaae74e8215b34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215b3b expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496461:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc029de600/0x8ebaae74e8215b34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215b3b expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478386.496466:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc029de600/0x8ebaae74e8215b34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215b3b expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478386.496471:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789478386.496714:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c962680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1876403964380288:0@lo:104: 00000100:00100000:1.0:1789478386.496722:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c960e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1876403964380416:0@lo:104: 00010000:00010000:1.0:1789478386.496749:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ebc42176000/0x8ebaae74e8215c45 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496921:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc029de600/0x8ebaae74e8215b34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215b3b expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496927:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478386.496938:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc029de600/0x8ebaae74e8215b34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215b3b expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496944:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc029de600/0x8ebaae74e8215b34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215b3b expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.496956:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478386.496958:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478386.496960:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478386.496966:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478386.496971:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478386.496992:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964380544:0@lo:103: 00000100:00100000:0.0:1789478386.497024:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478386.497089:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964381056:0@lo:103: 00000100:00100000:0.0:1789478386.497108:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478386.497199:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789478386.497205:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964380672:0@lo:103: 00000100:00100000:0.0:1789478386.497224:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478386.497273:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964380544 00000100:00100000:1.0:1789478386.497278:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964380544 00010000:00010000:1.0:1789478386.497303:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc42177800/0x8ebaae74e8215c30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215c29 expref: 22 pid: 6510 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478386.497334:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964381056 00000100:00100000:1.0:1789478386.497338:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964381056 00010000:00010000:1.0:1789478386.497349:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc35b67e00/0x8ebaae74e8215ba4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215b9d expref: 23 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478386.497368:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789478386.497376:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c897800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+23:3647:x1876403964380544:12345-0@lo:103: 00010000:00010000:1.0:1789478386.497385:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478386.497390:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc42177800/0x8ebaae74e8215c30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215c29 expref: 23 pid: 6510 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.497400:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc42177800/0x8ebaae74e8215c30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215c29 expref: 23 pid: 6510 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.497413:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc42177800/0x8ebaae74e8215c30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215c29 expref: 23 pid: 6510 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.497424:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478386.497461:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c897800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+22:3647:x1876403964380544:12345-0@lo:103: Request processed in 85us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478386.497467:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789478386.497490:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789478386.497497:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c896d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+21:3647:x1876403964381056:12345-0@lo:103: 00010000:00010000:1.0:1789478386.497505:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478386.497509:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc35b67e00/0x8ebaae74e8215ba4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215b9d expref: 21 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.497527:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc35b67e00/0x8ebaae74e8215ba4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215b9d expref: 21 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.497536:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc35b67e00/0x8ebaae74e8215ba4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215b9d expref: 21 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.497544:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478386.497567:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c896d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+20:3647:x1876403964381056:12345-0@lo:103: Request processed in 71us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478386.497573:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789478386.497669:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964380800:0@lo:103: 00000100:00100000:1.0:1789478386.498209:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964380672 00000100:00100000:1.0:1789478386.498215:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964380672 00010000:00010000:1.0:1789478386.498232:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc35b67000/0x8ebaae74e8215c06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215bff expref: 20 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478386.498251:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789478386.498259:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c894a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+20:3647:x1876403964380672:12345-0@lo:103: 00010000:00010000:1.0:1789478386.498266:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478386.498271:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc35b67000/0x8ebaae74e8215c06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215bff expref: 20 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.498281:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc35b67000/0x8ebaae74e8215c06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215bff expref: 20 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.498292:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc35b67000/0x8ebaae74e8215c06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215bff expref: 20 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.498310:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478386.498342:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478386.498372:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964381312:0@lo:103: 00000100:00100000:3.0:1789478386.498399:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478386.498413:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789478386.498418:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964380928:0@lo:103: 00000100:00100000:3.0:1789478386.498437:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478386.498470:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964380800 00000100:00100000:3.0:1789478386.498474:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964380800 00010000:00010000:3.0:1789478386.498499:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc029dee00/0x8ebaae74e8215bea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215bdc expref: 20 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478386.498512:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964381312 00000100:00100000:3.0:1789478386.498515:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964381312 00010000:00010000:3.0:1789478386.498524:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc00030c00/0x8ebaae74e8215b3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215b34 expref: 21 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478386.498533:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964380928 00000100:00100000:3.0:1789478386.498536:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964380928 00010000:00010000:3.0:1789478386.498545:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc029df000/0x8ebaae74e8215bc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215bb9 expref: 22 pid: 6510 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478386.498556:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789478386.498561:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08c60450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+22:3645:x1876403964380800:12345-0@lo:103: 00010000:00010000:3.0:1789478386.498570:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478386.498573:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc029dee00/0x8ebaae74e8215bea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215bdc expref: 22 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478386.498618:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc029dee00/0x8ebaae74e8215bea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215bdc expref: 22 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478386.498629:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc029dee00/0x8ebaae74e8215bea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215bdc expref: 22 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478386.498639:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478386.498668:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08c60450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+21:3645:x1876403964380800:12345-0@lo:103: Request processed in 106us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478386.498674:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789478386.498688:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789478386.498695:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+20:3645:x1876403964381312:12345-0@lo:103: 00010000:00010000:3.0:1789478386.498702:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478386.498706:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc00030c00/0x8ebaae74e8215b3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215b34 expref: 20 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478386.498714:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc00030c00/0x8ebaae74e8215b3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215b34 expref: 20 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478386.498723:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc00030c00/0x8ebaae74e8215b3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215b34 expref: 20 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478386.498733:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478386.498755:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+19:3645:x1876403964381312:12345-0@lo:103: Request processed in 60us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478386.498760:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789478386.498771:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789478386.498777:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+18:3645:x1876403964380928:12345-0@lo:103: 00010000:00010000:3.0:1789478386.498791:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478386.498796:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc029df000/0x8ebaae74e8215bc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215bb9 expref: 18 pid: 6510 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478386.498804:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc029df000/0x8ebaae74e8215bc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215bb9 expref: 18 pid: 6510 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478386.498812:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc029df000/0x8ebaae74e8215bc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215bb9 expref: 18 pid: 6510 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478386.498820:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478386.498842:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+17:3645:x1876403964380928:12345-0@lo:103: Request processed in 65us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478386.498848:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789478386.498873:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964380928:0@lo:103: 00000100:00100000:3.0:1789478386.498881:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964380800:0@lo:103: 00000100:00100000:3.0:1789478386.498888:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964381312:0@lo:103: 00000100:00100000:0.0:1789478386.499296:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964381184:0@lo:103: 00000100:00100000:0.0:1789478386.499321:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478386.499381:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964380544:0@lo:103: 00000100:00100000:0.0:1789478386.499390:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964381056:0@lo:103: 00000100:00100000:1.0:1789478386.499503:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c894a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:3647:x1876403964380672:12345-0@lo:103: Request processed in 1244us (2276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478386.499510:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789478386.499544:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964381184 00000100:00100000:1.0:1789478386.499549:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964381184 00010000:00010000:1.0:1789478386.499564:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc00031000/0x8ebaae74e8215b65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215b5e expref: 16 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478386.499630:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964380672:0@lo:103: 00000100:00100000:3.0:1789478386.499862:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789478386.499871:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c895180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+16:3647:x1876403964381184:12345-0@lo:103: 00010000:00010000:3.0:1789478386.499881:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478386.499886:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc00031000/0x8ebaae74e8215b65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215b5e expref: 16 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478386.499895:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc00031000/0x8ebaae74e8215b65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215b5e expref: 16 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478386.499906:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc00031000/0x8ebaae74e8215b65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215b5e expref: 16 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478386.499926:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ebc42176000/0x8ebaae74e8215c45 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478386.499933:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc42176000/0x8ebaae74e8215c45 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478386.499946:0:8446:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc42176000/0x8ebaae74e8215c45 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478386.499953:0:8446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc42176000/0x8ebaae74e8215c45 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478386.499960:0:8446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ebc42176000/0x8ebaae74e8215c45 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478386.499967:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ebc42176000/0x8ebaae74e8215c45 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478386.499972:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc42176000 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478386.499989:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ebc42176000/0x8ebaae74e8215c45 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478386.499998:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ebc42176000/0x8ebaae74e8215c45 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.500378:0:6511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ebc42176000/0x8ebaae74e8215c45 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.500387:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ebc42176000/0x8ebaae74e8215c45 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789478386.500401:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789478386.502819:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+15:9509:x1876403964379520:12345-0@lo:253: Request processed in 19062us (19994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478386.502832:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789478386.502929:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964379520:0@lo:253: 10000000:01000000:2.0:1789478386.502942:0:9509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789478386.502945:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789478386.502947:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789478386.502948:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478386.502950:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789478386.502951:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478386.502952:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478386.502954:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789478386.502955:0:9509:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789478386.502957:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478386.502958:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789478386.502988:0:9509:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ebc3f6c1800 from lustre-OST0001 10000000:01000000:2.0:1789478386.503018:0:9509:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789478386.503021:0:9509:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789478386.503030:0:9509:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ebc08d93370 local copy 10000000:01000000:2.0:1789478386.503034:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789478386.503065:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77200/0x8ebaae74e8215c4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.503088:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77200/0x8ebaae74e8215c4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.503098:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77200/0x8ebaae74e8215c4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478386.503114:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964381440:0@lo:101: 00000100:00100000:2.0:1789478386.503146:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478386.503183:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08c7d480 going to sleep for 11 seconds 00000100:00100000:1.0:1789478386.503227:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964381440 00000100:00100000:1.0:1789478386.503233:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964381440 00000100:00100000:1.0:1789478386.503274:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789478386.503283:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+15:9509:x1876403964381440:12345-0@lo:101: 00010000:00010000:1.0:1789478386.503293:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478386.503306:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc42177800/0x8ebaae74e8215c53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215c4c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.503325:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc42177800/0x8ebaae74e8215c53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215c4c expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.503335:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc42177800/0x8ebaae74e8215c53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215c4c expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.503344:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc42177800, rc 0) 00000100:00100000:1.0:1789478386.503370:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+16:9509:x1876403964381440:12345-0@lo:101: Request processed in 89us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478386.503382:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789478386.503460:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964381440:0@lo:101: 00010000:00010000:2.0:1789478386.503472:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77200/0x8ebaae74e8215c4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8ebaae74e8215c53 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.503490:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77200/0x8ebaae74e8215c4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8ebaae74e8215c53 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478386.503581:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964381568:0@lo:501: 00000100:00100000:2.0:1789478386.503637:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478386.503654:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08c7d480 going to sleep for 11 seconds 00000100:00100000:1.0:1789478386.503870:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964381568 00000100:00100000:1.0:1789478386.503875:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964381568 00000100:00100000:1.0:1789478386.503909:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789478386.503916:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:9509:x1876403964381568:12345-0@lo:501: 00000100:00100000:1.0:1789478386.503971:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:9509:x1876403964381568:12345-0@lo:501: Request processed in 56us (333us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789478386.503990:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00010000:3.0:1789478386.504074:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ebc42176000/0x8ebaae74e8215c45 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478386.504085:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc42176000/0x8ebaae74e8215c45 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478386.504108:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478386.504156:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c895180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+15:3647:x1876403964381184:12345-0@lo:103: Request processed in 4286us (4833us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478386.504163:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789478386.504245:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964381184:0@lo:103: 00000100:00100000:2.0:1789478386.504303:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964381568:0@lo:501: 10000000:01000000:2.0:1789478386.504315:0:9509:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789478386.504333:0:9509:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789478386.504338:0:9509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77200/0x8ebaae74e8215c4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8ebaae74e8215c53 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.504347:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77200/0x8ebaae74e8215c4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8ebaae74e8215c53 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.504359:0:9509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77200/0x8ebaae74e8215c4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8ebaae74e8215c53 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.504379:0:9509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789478386.504402:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ebc3f6c1800 10000000:01000000:2.0:1789478386.504406:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789478386.504410:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789478386.504412:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789478386.504416:0:9509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789478386.504418:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789478386.504433:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76e00/0x8ebaae74e8215c5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.504439:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76e00/0x8ebaae74e8215c5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.504568:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789478386.504575:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77200/0x8ebaae74e8215c4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x8ebaae74e8215c53 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.504583:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77200 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:1.0:1789478386.504586:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77200/0x8ebaae74e8215c4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x8ebaae74e8215c53 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.504622:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77200/0x8ebaae74e8215c4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0x8ebaae74e8215c53 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478386.504630:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77200/0x8ebaae74e8215c4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0x8ebaae74e8215c53 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478386.504635:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789478386.504653:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77200/0x8ebaae74e8215c4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x8ebaae74e8215c53 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.504659:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789478386.504686:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77200/0x8ebaae74e8215c4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x8ebaae74e8215c53 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.504693:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77200/0x8ebaae74e8215c4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x8ebaae74e8215c53 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.504702:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478386.504704:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478386.504706:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478386.504712:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789478386.504721:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964381824:0@lo:103: 00000100:00100000:1.0:1789478386.504749:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478386.504782:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964381824 00000100:00100000:1.0:1789478386.504785:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964381824 00000100:00100000:1.0:1789478386.504812:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789478386.504819:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c962680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+15:3645:x1876403964381824:12345-0@lo:103: 00010000:00010000:1.0:1789478386.504827:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478386.504839:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc42177800/0x8ebaae74e8215c53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ebaae74e8215c4c expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.504850:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478386.504888:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c962680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+14:3645:x1876403964381824:12345-0@lo:103: Request processed in 56us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478386.504894:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789478386.504919:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964381824:0@lo:103: 00010000:00010000:2.0:1789478386.505249:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76e00/0x8ebaae74e8215c5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478386.505263:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964381696:0@lo:101: 00000100:00100000:2.0:1789478386.505291:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478386.505306:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08c7df00 going to sleep for 11 seconds 00000100:00100000:2.0:1789478386.505321:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964381696 00000100:00100000:2.0:1789478386.505325:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964381696 00000100:00100000:2.0:1789478386.505347:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789478386.505353:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc272ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+14:9509:x1876403964381696:12345-0@lo:101: 00010000:00010000:2.0:1789478386.505362:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478386.505373:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc34f76400/0x8ebaae74e8215c61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215c5a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.505394:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc34f76400/0x8ebaae74e8215c61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215c5a expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.505404:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc34f76400/0x8ebaae74e8215c61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215c5a expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.505411:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76400, rc 0) 00000100:00100000:2.0:1789478386.505441:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc272ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+15:9509:x1876403964381696:12345-0@lo:101: Request processed in 87us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478386.505459:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789478386.505549:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964381696:0@lo:101: 00010000:00010000:2.0:1789478386.505560:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76e00/0x8ebaae74e8215c5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215c61 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.505568:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76e00/0x8ebaae74e8215c5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215c61 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478386.505702:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964381952:0@lo:501: 00000100:00100000:2.0:1789478386.505726:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478386.505740:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08c7df00 going to sleep for 11 seconds 00000100:00100000:2.0:1789478386.505752:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964381952 00000100:00100000:2.0:1789478386.505756:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964381952 00000100:00100000:2.0:1789478386.505777:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789478386.505782:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc272aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+15:9509:x1876403964381952:12345-0@lo:501: 00000100:00100000:2.0:1789478386.505862:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc272aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+15:9509:x1876403964381952:12345-0@lo:501: Request processed in 80us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478386.505868:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789478386.505905:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964381952:0@lo:501: 00000100:00100000:2.0:1789478386.505927:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964382080:0@lo:503: 00000100:00100000:2.0:1789478386.505960:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478386.505973:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08c7df00 going to sleep for 11 seconds 00000100:00100000:2.0:1789478386.505996:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964382080 00000100:00100000:2.0:1789478386.506000:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964382080 00000100:00100000:2.0:1789478386.506020:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789478386.506026:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+15:9509:x1876403964382080:12345-0@lo:503: 00000100:00100000:2.0:1789478386.506104:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+15:9509:x1876403964382080:12345-0@lo:503: Request processed in 77us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478386.506110:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789478386.506149:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964382080:0@lo:503: 00000040:00080000:2.0:1789478386.506350:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789478386.506412:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964382208:0@lo:502: 00000100:00100000:2.0:1789478386.506442:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478386.506457:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08c7df00 going to sleep for 11 seconds 00000100:00100000:2.0:1789478386.506469:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964382208 00000100:00100000:2.0:1789478386.506474:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964382208 00000100:00100000:2.0:1789478386.506864:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789478386.506872:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+15:9509:x1876403964382208:12345-0@lo:502: 00000100:00100000:2.0:1789478386.506965:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+15:9509:x1876403964382208:12345-0@lo:502: Request processed in 94us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478386.506972:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789478386.507047:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964382208:0@lo:502: 00000040:00080000:1.0:1789478386.507247:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789478386.507273:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789478386.507297:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789478386.507309:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789478386.507322:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789478386.507335:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789478386.507354:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c960e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964382336:0@lo:502: 00000100:00100000:1.0:1789478386.507388:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478386.507653:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34de1600 going to sleep for 11 seconds 00000100:00100000:3.0:1789478386.507787:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964382336 00000100:00100000:3.0:1789478386.507792:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964382336 00000100:00100000:3.0:1789478386.507819:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789478386.507827:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+15:9509:x1876403964382336:12345-0@lo:502: 00000100:00100000:3.0:1789478386.507905:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+15:9509:x1876403964382336:12345-0@lo:502: Request processed in 79us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478386.507912:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789478386.508026:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c960e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964382336:0@lo:502: 00000040:00080000:1.0:1789478386.508062:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789478386.508070:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:2.0:1789478386.508888:0:9520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789478386.508895:0:9520:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1789478386.508902:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478386.508910:0:9520:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789478386.508916:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789478386.508929:0:9520:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8ebc2715b370) 00000020:00000080:2.0:1789478386.508948:0:9520:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789478386.508954:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789478386.509023:0:9520:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ebc3f6c1800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789478386.509031:0:9520:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789478386.509037:0:9520:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8ebaae74e8215c6f 00010000:00010000:1.0:1789478386.519003:0:9520:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1789478386.520337:0:9520:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789478386.524304:0:9520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789478386.524928:0:9520:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1789478386.530934:0:9520:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1789478386.531126:0:9520:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1789478386.540942:0:9520:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1789478386.542464:0:9520:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789478386.542474:0:9520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789478386.542491:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478386.542494:0:9520:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789478386.542497:0:9520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789478386.542502:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478386.542503:0:9520:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789478386.542507:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789478386.542509:0:9520:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789478386.542525:0:9520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789478386.542528:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478386.542529:0:9520:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789478386.542533:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789478386.542821:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1789478386.542846:0:9509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789478386.542867:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76e00/0x8ebaae74e8215c5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215c61 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.542878:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76e00/0x8ebaae74e8215c5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215c61 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478386.542886:0:9509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebc3f6c1800 from 1 10000000:01000000:1.0:1789478386.542889:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789478386.542918:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc42176000/0x8ebaae74e8215c76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.542935:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc42176000/0x8ebaae74e8215c76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.542947:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc42176000/0x8ebaae74e8215c76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478386.542967:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c960e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964382464:0@lo:101: 00000100:00100000:1.0:1789478386.543032:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478386.543083:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb032019c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478386.545821:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964382464 00000100:00100000:2.0:1789478386.545835:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964382464 00000100:00100000:2.0:1789478386.545889:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789478386.545898:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+15:9509:x1876403964382464:12345-0@lo:101: 00010000:00010000:2.0:1789478386.545913:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478386.545928:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc34f76000/0x8ebaae74e8215c7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215c76 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.545951:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc34f76000/0x8ebaae74e8215c7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215c76 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.545961:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc34f76000/0x8ebaae74e8215c7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215c76 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.545989:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76000, rc 0) 00000100:00100000:2.0:1789478386.548294:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:9509:x1876403964382464:12345-0@lo:101: Request processed in 2391us (5255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478386.548304:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789478386.548665:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c960e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964382464:0@lo:101: 00010000:00010000:2.0:1789478386.548687:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc42176000/0x8ebaae74e8215c76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215c7d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.548698:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc42176000/0x8ebaae74e8215c76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215c7d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478386.548795:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964382592:0@lo:501: 00000100:00100000:2.0:1789478386.548836:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478386.548869:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc07dbce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789478386.549036:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964382592 00000100:00100000:3.0:1789478386.549042:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964382592 00000100:00100000:3.0:1789478386.549087:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789478386.549095:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:9509:x1876403964382592:12345-0@lo:501: 00000100:00100000:2.0:1789478386.549359:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964382592:0@lo:501: 00000100:00100000:2.0:1789478386.549386:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964382720:0@lo:503: 00000100:00100000:2.0:1789478386.549428:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478386.549458:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc07dbce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789478386.549569:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964382720 00000100:00100000:0.0:1789478386.549573:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964382720 00000100:00100000:0.0:1789478386.549628:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789478386.549636:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+17:9509:x1876403964382720:12345-0@lo:503: 00000100:00100000:0.0:1789478386.549710:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+17:9509:x1876403964382720:12345-0@lo:503: Request processed in 75us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478386.549717:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789478386.549828:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:9509:x1876403964382592:12345-0@lo:501: Request processed in 90us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478386.549837:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789478386.549975:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964382720:0@lo:503: 00000040:00080000:2.0:1789478386.550205:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789478386.550263:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964382848:0@lo:502: 00000100:00100000:2.0:1789478386.550297:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478386.550321:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc07dbce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789478386.550807:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964382848 00000100:00100000:0.0:1789478386.550811:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964382848 00000100:00100000:0.0:1789478386.550842:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789478386.550849:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:9509:x1876403964382848:12345-0@lo:502: 00000100:00100000:0.0:1789478386.550921:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:9509:x1876403964382848:12345-0@lo:502: Request processed in 72us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478386.550928:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789478386.551108:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964382848:0@lo:502: 00000040:00080000:2.0:1789478386.551380:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789478386.551408:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789478386.551430:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964382976:0@lo:502: 00000100:00100000:2.0:1789478386.551732:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478386.551754:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc07dbce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789478386.551837:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964382976 00000100:00100000:0.0:1789478386.551842:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964382976 00000100:00100000:0.0:1789478386.551873:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789478386.551879:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+16:9509:x1876403964382976:12345-0@lo:502: 00000100:00100000:0.0:1789478386.551950:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+16:9509:x1876403964382976:12345-0@lo:502: Request processed in 70us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478386.551956:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789478386.552045:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964382976:0@lo:502: 00000040:00080000:2.0:1789478386.552089:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789478386.552096:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789478386.560384:0:9524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789478386.560396:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478386.560398:0:9524:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789478386.560405:0:9524:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ebc3f6c1800 00000020:00000080:3.0:1789478386.560408:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789478386.560419:0:9524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789478386.560422:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478386.560423:0:9524:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789478386.560426:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789478386.560774:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789478386.560800:0:9509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789478386.560814:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc42176000/0x8ebaae74e8215c76 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215c7d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.560826:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc42176000/0x8ebaae74e8215c76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215c7d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478386.560873:0:9509:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789478386.560876:0:9509:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ebc3f6c1800 10000000:01000000:2.0:1789478386.560879:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ebc3f6c1800 10000000:01000000:2.0:1789478386.560883:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789478386.560888:0:9509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ebc3f6c1800 from 1 10000000:01000000:2.0:1789478386.560891:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789478386.560922:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76c00/0x8ebaae74e8215c84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.560931:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76c00/0x8ebaae74e8215c84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.560941:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76c00/0x8ebaae74e8215c84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478386.560969:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964383104:0@lo:101: 00000100:00100000:2.0:1789478386.561036:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478386.561071:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc07dbc540 going to sleep for 11 seconds 00000100:00100000:2.0:1789478386.561091:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964383104 00000100:00100000:2.0:1789478386.561098:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964383104 00000100:00100000:2.0:1789478386.561135:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789478386.561144:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:9509:x1876403964383104:12345-0@lo:101: 00010000:00010000:2.0:1789478386.561155:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478386.561167:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc34f77800/0x8ebaae74e8215c8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215c84 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.561197:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc34f77800/0x8ebaae74e8215c8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215c84 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.561207:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc34f77800/0x8ebaae74e8215c8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215c84 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.561216:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f77800, rc 0) 00000100:00100000:2.0:1789478386.561251:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+17:9509:x1876403964383104:12345-0@lo:101: Request processed in 108us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478386.561257:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789478386.561305:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964383104:0@lo:101: 00010000:00010000:2.0:1789478386.561317:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76c00/0x8ebaae74e8215c84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215c8b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.561326:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76c00/0x8ebaae74e8215c84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215c8b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478386.561407:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964383232:0@lo:501: 00000100:00100000:2.0:1789478386.561431:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478386.561443:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc07dbc540 going to sleep for 11 seconds 00000100:00100000:3.0:1789478386.561800:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964383232 00000100:00100000:3.0:1789478386.561811:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964383232 00000100:00100000:3.0:1789478386.561839:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789478386.561847:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+17:9509:x1876403964383232:12345-0@lo:501: 00000100:00100000:3.0:1789478386.561937:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+17:9509:x1876403964383232:12345-0@lo:501: Request processed in 90us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478386.561944:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789478386.562033:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964383232:0@lo:501: 00000100:00100000:1.0:1789478386.562061:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c963b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964383360:0@lo:503: 00000100:00100000:1.0:1789478386.562099:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478386.562129:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03201cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478386.562175:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964383360 00000100:00100000:3.0:1789478386.562178:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964383360 00000100:00100000:3.0:1789478386.562220:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789478386.562227:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+17:9509:x1876403964383360:12345-0@lo:503: 00000100:00100000:3.0:1789478386.562298:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+17:9509:x1876403964383360:12345-0@lo:503: Request processed in 71us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478386.562304:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789478386.562381:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c963b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964383360:0@lo:503: 00000040:00080000:1.0:1789478386.562623:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789478386.562680:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c963b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964383488:0@lo:502: 00000100:00100000:1.0:1789478386.562714:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478386.562732:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03201cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478386.563034:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964383488 00000100:00100000:3.0:1789478386.563038:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964383488 00000100:00100000:3.0:1789478386.563059:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789478386.563065:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+17:9509:x1876403964383488:12345-0@lo:502: 00000100:00100000:3.0:1789478386.563134:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+17:9509:x1876403964383488:12345-0@lo:502: Request processed in 68us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478386.563141:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789478386.563815:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c963b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964383488:0@lo:502: 00000040:00080000:1.0:1789478386.564000:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789478386.564024:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789478386.564034:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789478386.564045:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789478386.564057:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789478386.564067:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789478386.564080:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789478386.564104:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789478386.564118:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789478386.564131:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789478386.564144:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789478386.564156:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789478386.564169:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789478386.564182:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789478386.564270:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789478386.564290:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789478386.564304:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789478386.564317:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789478386.564330:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789478386.564344:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789478386.564355:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789478386.564417:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789478386.564438:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789478386.564465:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789478386.565273:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789478386.565304:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789478386.565338:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789478386.565356:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1789478386.565764:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789478386.565783:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1789478386.565797:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1789478386.565810:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1789478386.565822:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1789478386.565833:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1789478386.565845:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1789478386.565856:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1789478386.565867:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1789478386.565878:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1789478386.565890:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1789478386.565902:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1789478386.565923:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1789478386.565935:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1789478386.565957:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1789478386.565971:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1789478386.565997:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1789478386.566011:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1789478386.566047:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c963b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964383616:0@lo:502: 00000100:00100000:1.0:1789478386.566109:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478386.566263:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03201cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478386.567814:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964383616 00000100:00100000:3.0:1789478386.567825:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964383616 00000100:00100000:3.0:1789478386.567910:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789478386.567920:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+17:9509:x1876403964383616:12345-0@lo:502: 00000100:00100000:3.0:1789478386.568069:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+17:9509:x1876403964383616:12345-0@lo:502: Request processed in 151us (1959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478386.568077:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789478386.568178:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c963b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964383616:0@lo:502: 00000040:00080000:1.0:1789478386.568255:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1789478386.568266:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1789478386.569034:0:9525:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789478386.569049:0:9525:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8ebc34c70000) 00000020:00000080:1.0:1789478386.569071:0:9525:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1789478386.569150:0:9525:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ebc3f6c1800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789478386.569153:0:9525:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ebc3f6c1800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789478386.569156:0:9525:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ebc3f6c1800 3 00010000:00080000:1.0:1789478386.569182:0:9525:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ebc40ca8000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.111@tcp at head 00010000:00010000:1.0:1789478386.574812:0:9525:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1789478386.575072:0:9525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789478386.575115:0:9525:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789478386.575127:0:9525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8ebaae74e8215c99 00000100:00080000:1.0:1789478386.575136:0:9525:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789478386.575147:0:9525:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ebc40ca8000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1789478386.575179:0:9525:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebc3c963b80 x1876403964383744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789478386.575222:0:9525:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789478386.575337:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964383872:0@lo:400: 00000100:00100000:1.0:1789478386.575397:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478386.575427:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964384384:0@lo:400: 00000100:00100000:1.0:1789478386.575460:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478386.575491:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789478386.575498:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964384000:0@lo:400: 00000100:00100000:1.0:1789478386.575522:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478386.575540:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964384512:0@lo:400: 00000100:00100000:1.0:1789478386.575560:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478386.575915:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876403964383744:0@lo:38: 00000100:00100000:1.0:1789478386.576100:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964384128:0@lo:400: 00000100:00100000:1.0:1789478386.576125:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478386.576143:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964384640:0@lo:400: 00000100:00100000:1.0:1789478386.576164:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478386.576297:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478386.576347:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789478386.576357:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964384256:0@lo:400: 00000100:00100000:1.0:1789478386.576381:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478386.576393:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964384768:0@lo:400: 00000100:00100000:1.0:1789478386.576412:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478386.576459:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964383872 00000100:00100000:1.0:1789478386.576466:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964383872 00000100:00100000:1.0:1789478386.576764:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964384384 00000100:00100000:1.0:1789478386.576769:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964384384 00000100:00100000:0.0:1789478386.576852:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964384640 00000100:00100000:0.0:1789478386.576856:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964384640 00000100:00100000:1.0:1789478386.579857:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964384512 00000100:00100000:1.0:1789478386.579867:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964384512 00000100:00080000:3.0:1789478386.580287:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789478386.580292:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789478386.580295:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789478386.580636:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964384768 00000100:00100000:0.0:1789478386.580647:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964384768 00000100:00100000:0.0:1789478386.580679:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789478386.580688:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964384640:12345-0@lo:400: 00000100:00100000:0.0:1789478386.580766:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964384640:12345-0@lo:400: Request processed in 79us (4600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478386.580773:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789478386.580788:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789478386.580793:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964384768:12345-0@lo:400: 00000100:00100000:0.0:1789478386.580818:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964384768:12345-0@lo:400: Request processed in 26us (4406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478386.580823:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789478386.580923:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb03353b80 x1876403964384768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478386.580936:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964384768:0@lo:400: 00010000:00080000:0.0:1789478386.580948:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc3c961180 x1876403964384640/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478386.580955:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964384640:0@lo:400: 00000100:00080000:3.0:1789478386.581140:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789478386.581790:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964384000 00000100:00100000:0.0:1789478386.581797:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964384000 00000100:00100000:0.0:1789478386.581836:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964384128 00000100:00100000:0.0:1789478386.581839:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964384128 00000100:00100000:0.0:1789478386.581855:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789478386.581862:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964384000:12345-0@lo:400: 00000100:00100000:0.0:1789478386.581916:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964384000:12345-0@lo:400: Request processed in 55us (6393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478386.581923:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789478386.581946:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789478386.581954:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964384128:12345-0@lo:400: 00000100:00100000:0.0:1789478386.582019:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964384128:12345-0@lo:400: Request processed in 66us (5892us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478386.582025:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789478386.582044:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964383744 00000100:00100000:0.0:1789478386.582048:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964383744 00000100:00100000:0.0:1789478386.582059:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964384256 00000100:00100000:0.0:1789478386.582061:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964384256 00000100:00100000:0.0:1789478386.582091:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789478386.582097:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964383872:12345-0@lo:400: 00000100:00100000:0.0:1789478386.582128:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964383872:12345-0@lo:400: Request processed in 32us (6732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478386.582135:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789478386.582148:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789478386.582154:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964384384:12345-0@lo:400: 00000100:00100000:0.0:1789478386.582180:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964384384:12345-0@lo:400: Request processed in 27us (6720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478386.582197:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789478386.582208:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789478386.582214:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964384256:12345-0@lo:400: 00000100:00100000:0.0:1789478386.582239:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964384256:12345-0@lo:400: Request processed in 26us (5857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478386.582245:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789478386.582256:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789478386.582260:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876403964383744:12345-0@lo:38: 00010000:00080000:0.0:1789478386.582278:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:0.0:1789478386.582318:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8ebaae74e8215ca0 00000004:00100000:0.0:1789478386.582332:0:6519:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789478386.582360:0:6519:0:(import.c:65:import_set_state_nolock()) ffff8ebc3f688000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789478386.582398:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876403964383744:12345-0@lo:38: Request processed in 137us (6102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478386.582404:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789478386.582441:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc3c963b80 x1876403964383744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789478396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478386.582451:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789478386.582457:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789478386.582464:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789478386.582468:0:3644:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789478386.582470:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc40ca8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789478386.582475:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876403964383744:0@lo:38: 00010000:00080000:0.0:1789478386.582921:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc3c962300 x1876403964384256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478386.582933:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964384256:0@lo:400: 00000100:00100000:0.0:1789478386.582946:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964384128:0@lo:400: 00000100:00100000:0.0:1789478386.582974:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964384000:0@lo:400: 00010000:00080000:0.0:1789478386.582999:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc3c960380 x1876403964383872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478386.583008:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964383872:0@lo:400: 00010000:00080000:0.0:1789478386.583017:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc3c960a80 x1876403964384384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478386.583039:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964384384:0@lo:400: 00000100:00100000:1.0:1789478386.586270:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789478386.586283:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964384512:12345-0@lo:400: 00000100:00100000:1.0:1789478386.586353:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964384512:12345-0@lo:400: Request processed in 74us (10792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478386.586369:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1789478386.587267:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc3c960e00 x1876403964384512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478386.587281:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964384512:0@lo:400: 00000100:00100000:2.0:1789478386.587416:0:9527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecdc00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9527:1876403964384896:0@lo:901: 00000100:00100000:2.0:1789478386.587561:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478386.587854:0:9527:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08db3d80 going to sleep for 11 seconds 00000020:01000004:2.0:1789478386.587893:0:9525:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789478386.587905:0:9525:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8ebc2715cd28) 00000020:00000080:2.0:1789478386.587925:0:9525:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1789478386.588019:0:9525:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ebc3f6c1800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789478386.588022:0:9525:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ebc3f6c1800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789478386.588024:0:9525:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ebc3f6c1800 3 00010000:00080000:2.0:1789478386.588047:0:9525:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ebb027e4000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.111@tcp at head 00010000:00010000:2.0:1789478386.591164:0:9525:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1789478386.591398:0:9525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1789478386.591438:0:9525:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789478386.591472:0:9525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x8ebaae74e8215cae 00000100:00080000:2.0:1789478386.591552:0:9525:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789478386.591570:0:9525:0:(import.c:625:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8ebb027e4000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1789478386.592155:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964384896 00000100:00100000:0.0:1789478386.592163:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964384896 00000100:00100000:2.0:1789478386.592308:0:9525:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebc40ecea00 x1876403964385024/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789478386.592334:0:9525:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789478386.592873:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789478386.592883:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9527:x1876403964384896:12345-0@lo:901: 00000100:00100000:2.0:1789478386.593008:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9527:x1876403964384896:12345-0@lo:901: Request processed in 126us (5445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478386.593024:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789478386.593065:0:9527:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc40ecdc00 x1876403964384896/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789478402 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478386.593078:0:9527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecdc00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9527:1876403964384896:0@lo:901: 00000100:00080000:3.0:1789478386.593282:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789478386.593404:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876403964385024:0@lo:38: 00000100:00100000:0.0:1789478386.593557:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789478386.593845:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1789478386.595588:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1789478386.595644:0:9509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789478386.595664:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76c00/0x8ebaae74e8215c84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215c8b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.595675:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76c00/0x8ebaae74e8215c84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215c8b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789478386.595723:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789478386.595725:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789478386.595726:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789478386.595728:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789478386.595729:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789478386.595730:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789478386.595731:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789478386.595733:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789478386.595734:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789478386.595735:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789478386.595737:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789478386.595740:0:9509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1789478386.595742:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789478386.595743:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789478386.595748:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789478386.595749:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789478386.595750:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789478386.595751:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789478386.595752:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789478386.595753:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789478386.595754:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789478386.595755:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789478386.595756:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789478386.595777:0:9509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789478386.595790:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c897100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964385152:0@lo:253: 00000100:00100000:0.0:1789478386.595845:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478386.595878:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40ecb840 going to sleep for 11 seconds 00000100:00100000:1.0:1789478386.596711:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964385152 00000100:00100000:1.0:1789478386.596720:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964385152 00000100:00100000:1.0:1789478386.596767:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789478386.596776:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+17:9509:x1876403964385152:12345-0@lo:253: 20000000:01000000:1.0:1789478386.596801:0:6510:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789478386.596814:0:6510:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789478386.597153:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964385024 00000100:00100000:3.0:1789478386.597159:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964385024 00000100:00100000:3.0:1789478386.597294:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789478386.597301:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876403964385024:12345-0@lo:38: 00010000:00080000:3.0:1789478386.597322:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:3.0:1789478386.597353:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x8ebaae74e8215cb5 00000004:00100000:3.0:1789478386.597367:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789478386.597395:0:6517:0:(import.c:65:import_set_state_nolock()) ffff8ebc3f6c4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789478386.597779:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876403964385024:12345-0@lo:38: Request processed in 476us (4221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478386.597786:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 20000000:01000000:2.0:1789478386.605841:0:6510:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789478386.605857:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789478386.606284:0:6533:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789478386.606289:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789478386.606309:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215cbc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.606327:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc029df200/0x8ebaae74e8215bb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215bab expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.606335:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc35b66400/0x8ebaae74e8215bf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215bf1 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.606342:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215cbc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.606382:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc35b66400/0x8ebaae74e8215bf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215bf1 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.606396:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc35b66400/0x8ebaae74e8215bf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215bf1 expref: 17 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478386.606860:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1876403964385280:0@lo:104: 00000100:00100000:2.0:1789478386.606919:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789478386.606991:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc029df200/0x8ebaae74e8215bb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215bab expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.607001:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc029df200/0x8ebaae74e8215bb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215bab expref: 17 pid: 6510 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478386.607011:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1876403964385408:0@lo:104: 00000100:00100000:2.0:1789478386.607033:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478386.607051:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34f72c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789478386.607073:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964385280 00000100:00100000:2.0:1789478386.607078:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964385280 00000100:00100000:2.0:1789478386.607110:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964385408 00000100:00100000:2.0:1789478386.607113:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964385408 00000100:00100000:2.0:1789478386.607128:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789478386.607136:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+4:6533:x1876403964385280:12345-0@lo:104: 00010000:00010000:2.0:1789478386.607147:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215bf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215bf8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1789478386.607345:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc40ecea00 x1876403964385024/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789478396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478386.607356:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789478386.607364:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789478386.607371:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789478386.607375:0:3644:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789478386.607378:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebb027e4000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789478386.607384:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876403964385024:0@lo:38: 00010000:00010000:2.0:1789478386.608727:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789478386.608739:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+4:6533:x1876403964385280:12345-0@lo:104: Request processed in 1602us (1818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478386.608748:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789478386.608775:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789478386.608785:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+3:6533:x1876403964385408:12345-0@lo:104: 00010000:00010000:2.0:1789478386.608796:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc029de800/0x8ebaae74e8215bab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215bb2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478386.610762:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1876403964385280:0@lo:104: 00000100:00100000:1.0:1789478386.610775:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1876403964385408:0@lo:104: 00010000:00010000:1.0:1789478386.610796:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215cbc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478386.610883:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+17:9509:x1876403964385152:12345-0@lo:253: Request processed in 14107us (15036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478386.610893:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789478386.610999:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c897100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c56e5039-4535-4d8a-bd01-962355b55f9c:9509:1876403964385152:0@lo:253: 10000000:01000000:3.0:1789478386.611010:0:9509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789478386.611013:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789478386.611015:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789478386.611016:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789478386.611017:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789478386.611019:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789478386.611020:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789478386.611021:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789478386.611023:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789478386.611024:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789478386.611026:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789478386.611027:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789478386.611038:0:9509:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1789478386.612612:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789478386.612624:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215bf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215bf8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.612634:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc00031800 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478386.612638:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215bf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215bf8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478386.612647:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215bf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215bf8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478386.612670:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215bf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215bf8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478386.612676:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789478386.613357:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215bf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215bf8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.613366:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789478386.613385:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215bf1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215bf8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.613393:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc00031800/0x8ebaae74e8215bf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215bf8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.613409:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789478386.613413:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc029de800/0x8ebaae74e8215bab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215bb2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.613430:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029de800 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:1.0:1789478386.613433:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc029de800/0x8ebaae74e8215bab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215bb2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.613441:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc029de800/0x8ebaae74e8215bab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215bb2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478386.613458:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc029de800/0x8ebaae74e8215bab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215bb2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478386.613464:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789478386.613485:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc029de800/0x8ebaae74e8215bab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215bb2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.613490:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789478386.613497:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc029de800/0x8ebaae74e8215bab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215bb2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.613502:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc029de800/0x8ebaae74e8215bab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215bb2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.613517:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478386.613518:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478386.613520:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478386.613536:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03353800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964385664:0@lo:103: 00000100:00100000:1.0:1789478386.613616:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478386.613660:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789478386.613667:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964385536:0@lo:103: 00000100:00100000:1.0:1789478386.613698:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478386.613737:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964385664 00000100:00100000:1.0:1789478386.613743:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964385664 00010000:00010000:1.0:1789478386.613769:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc029df200/0x8ebaae74e8215bb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215bab expref: 17 pid: 6510 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478386.613792:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964385536 00000100:00100000:1.0:1789478386.613795:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964385536 00010000:00010000:1.0:1789478386.613804:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc35b66400/0x8ebaae74e8215bf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215bf1 expref: 18 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478386.613820:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789478386.613828:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03352d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+18:3648:x1876403964385664:12345-0@lo:103: 00010000:00010000:1.0:1789478386.613839:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478386.613843:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc029df200/0x8ebaae74e8215bb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215bab expref: 18 pid: 6510 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.613852:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc029df200/0x8ebaae74e8215bb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215bab expref: 18 pid: 6510 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.613864:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc029df200/0x8ebaae74e8215bb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215bab expref: 18 pid: 6510 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.613874:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478386.613905:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03352d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+17:3648:x1876403964385664:12345-0@lo:103: Request processed in 77us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478386.613911:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789478386.613926:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789478386.613932:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03352300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+16:3648:x1876403964385536:12345-0@lo:103: 00010000:00010000:1.0:1789478386.613939:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478386.613949:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc35b66400/0x8ebaae74e8215bf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215bf1 expref: 16 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.613958:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc35b66400/0x8ebaae74e8215bf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215bf1 expref: 16 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.613966:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc35b66400/0x8ebaae74e8215bf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215bf1 expref: 16 pid: 6511 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.613989:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215cbc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.613997:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215cbc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789478386.614010:0:8446:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007722024s 00010000:00010000:1.0:1789478386.614015:0:8446:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215cbc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.614021:0:8446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215cbc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.614028:0:8446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215cbc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.614033:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215cbc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.614037:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77a00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:1.0:1789478386.614042:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215cbc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.614048:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215cbc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.614068:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215cbc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.614078:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478386.614100:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03352300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+15:3648:x1876403964385536:12345-0@lo:103: Request processed in 168us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478386.614106:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789478386.614137:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964385536:0@lo:103: 00000100:00100000:1.0:1789478386.614144:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03353800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964385664:0@lo:103: 00010000:00010000:1.0:1789478386.614166:0:6533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215cbc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.614174:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215cbc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478386.614181:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215cbc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478386.617819:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789478386.617834:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+3:6533:x1876403964385408:12345-0@lo:104: Request processed in 9048us (10796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478386.617851:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00080000:10000000:3.0:1789478386.618431:0:9509:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1789478386.619322:0:9509:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789478386.619549:0:9509:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1789478386.620055:0:9509:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789478386.620220:0:9509:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1789478386.620387:0:9509:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1789478386.621434:0:9509:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1789478386.625917:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789478386.631565:0:9509:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789478386.631960:0:9509:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789478386.632010:0:9509:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789478386.632048:0:9509:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.111@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789478386.632067:0:9509:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1789478386.632083:0:9509:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1789478386.633117:0:9509:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789478386.634410:0:9509:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789478387.238497:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478387.429648:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964385792:0@lo:13: 00000100:00100000:1.0:1789478387.429715:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478387.429957:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964385792 00000100:00100000:0.0:1789478387.429964:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964385792 00000100:00100000:0.0:1789478387.430026:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789478387.430035:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964385792:12345-0@lo:13: 00002000:00000024:0.0:1789478387.430061:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478387.430105:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964385792:12345-0@lo:13: Request processed in 72us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478387.430117:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789478387.430153:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c897800 x1876403964385792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478387.430170:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964385792:0@lo:13: 00000020:00000004:2.0:1789478387.610248:0:9581:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789478387.610459:0:9581:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789478387.942206:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964385920:0@lo:13: 00000100:00100000:2.0:1789478387.942272:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478387.943642:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964385920 00000100:00100000:0.0:1789478387.943652:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964385920 00000100:00100000:0.0:1789478387.943701:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789478387.943710:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964385920:12345-0@lo:13: 00002000:00000024:0.0:1789478387.943733:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478387.949654:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964385920:12345-0@lo:13: Request processed in 5936us (7373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478387.949668:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789478387.951460:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03351180 x1876403964385920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478387.951726:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964385920:0@lo:13: 00010000:00010000:1.0:1789478388.262612:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478389.286234:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478389.482829:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964386048:0@lo:41: 00000100:00100000:1.0:1789478389.482892:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478389.482956:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789478389.482971:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964386048 00000100:00100000:1.0:1789478389.482976:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964386176:0@lo:41: 00000100:00100000:0.0:1789478389.482981:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964386048 00000100:00100000:1.0:1789478389.483000:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478389.483035:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964386176 00000100:00100000:1.0:1789478389.483040:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964386176 00000100:00100000:0.0:1789478389.483053:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789478389.483065:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964386048:12345-0@lo:41: 00000100:00100000:1.0:1789478389.483070:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789478389.483080:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964386176:12345-0@lo:41: 00000004:00000024:1.0:1789478389.483101:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000004:00000024:0.0:1789478389.483104:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789478389.483145:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964386176:12345-0@lo:41: Request processed in 67us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478389.483153:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789478389.483158:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964386048:12345-0@lo:41: Request processed in 94us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478389.483166:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789478389.483206:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964386176:0@lo:41: 00000100:00100000:1.0:1789478389.483215:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964386048:0@lo:41: 00010000:00010000:1.0:1789478390.308779:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478391.334231:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478392.040934:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964386304:0@lo:400: 00000100:00100000:1.0:1789478392.041009:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478392.041063:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964386816:0@lo:400: 00000100:00100000:1.0:1789478392.041087:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478392.041103:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964387328:0@lo:400: 00000100:00100000:1.0:1789478392.041124:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478392.041146:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789478392.041159:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03352680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964386432:0@lo:400: 00000100:00100000:3.0:1789478392.041315:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964386304 00000100:00100000:3.0:1789478392.041323:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964386304 00000100:00100000:1.0:1789478392.041398:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478392.041415:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964386944:0@lo:400: 00000100:00100000:1.0:1789478392.041434:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478392.041449:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964387456:0@lo:400: 00000100:00100000:1.0:1789478392.041471:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478392.041492:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964386560:0@lo:400: 00000100:00100000:1.0:1789478392.041513:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478392.041539:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964387072:0@lo:400: 00000100:00100000:1.0:1789478392.041558:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478392.041567:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964387584:0@lo:400: 00000100:00100000:1.0:1789478392.041582:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478392.041608:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789478392.041613:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964386688:0@lo:400: 00000100:00100000:1.0:1789478392.041632:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478392.041645:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964387200:0@lo:400: 00000100:00100000:1.0:1789478392.041660:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478392.041695:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964386816 00000100:00100000:1.0:1789478392.041699:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964386816 00000100:00100000:1.0:1789478392.041718:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964386432 00000100:00100000:1.0:1789478392.041720:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964386432 00000100:00100000:1.0:1789478392.041728:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964386944 00000100:00100000:1.0:1789478392.041730:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964386944 00000100:00100000:1.0:1789478392.041748:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964387456 00000100:00100000:1.0:1789478392.041750:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964387456 00000100:00100000:1.0:1789478392.041758:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964387072 00000100:00100000:1.0:1789478392.041760:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964387072 00000100:00100000:1.0:1789478392.041769:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964387584 00000100:00100000:1.0:1789478392.041776:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964387584 00000100:00100000:1.0:1789478392.041792:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789478392.041801:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964386816:12345-0@lo:400: 00000100:00100000:1.0:1789478392.041845:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964386816:12345-0@lo:400: Request processed in 44us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478392.041851:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789478392.041865:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789478392.041870:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964386432:12345-0@lo:400: 00000100:00100000:1.0:1789478392.041894:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964386432:12345-0@lo:400: Request processed in 24us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478392.041900:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789478392.041912:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789478392.041918:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964386944:12345-0@lo:400: 00000100:00100000:1.0:1789478392.041941:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964386944:12345-0@lo:400: Request processed in 24us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478392.041946:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789478392.041966:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789478392.041972:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964387456:12345-0@lo:400: 00000100:00100000:1.0:1789478392.041993:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964387456:12345-0@lo:400: Request processed in 22us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478392.041998:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789478392.042007:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789478392.042012:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964387072:12345-0@lo:400: 00000100:00100000:1.0:1789478392.042036:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964387072:12345-0@lo:400: Request processed in 25us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478392.042052:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789478392.042069:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789478392.042074:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964387584:12345-0@lo:400: 00000100:00100000:1.0:1789478392.042100:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964387584:12345-0@lo:400: Request processed in 26us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478392.042105:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789478392.042121:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964387328 00000100:00100000:1.0:1789478392.042124:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964387328 00000100:00100000:1.0:1789478392.042145:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964387200 00000100:00100000:1.0:1789478392.042148:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964387200 00000100:00100000:1.0:1789478392.042163:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789478392.042182:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964387328:12345-0@lo:400: 00000100:00100000:1.0:1789478392.042209:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964387328:12345-0@lo:400: Request processed in 29us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478392.042215:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789478392.042225:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789478392.042230:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964387200:12345-0@lo:400: 00000100:00100000:1.0:1789478392.042255:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964387200:12345-0@lo:400: Request processed in 25us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478392.042260:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789478392.042282:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964386560 00000100:00100000:1.0:1789478392.042285:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964386560 00000100:00100000:1.0:1789478392.042308:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964386688 00000100:00100000:1.0:1789478392.042310:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964386688 00000100:00100000:1.0:1789478392.042320:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789478392.042324:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964386560:12345-0@lo:400: 00000100:00100000:1.0:1789478392.042351:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964386560:12345-0@lo:400: Request processed in 26us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478392.042356:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789478392.042373:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789478392.042379:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964386688:12345-0@lo:400: 00000100:00100000:1.0:1789478392.042416:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964386688:12345-0@lo:400: Request processed in 37us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478392.042422:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1789478392.042444:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789478392.042447:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789478392.042449:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789478392.042481:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964386688:0@lo:400: 00010000:00080000:1.0:1789478392.042493:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb035a4700 x1876403964387200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478392.042502:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964387200:0@lo:400: 00000100:00100000:1.0:1789478392.042510:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964386560:0@lo:400: 00010000:00080000:1.0:1789478392.042520:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb035a7480 x1876403964387072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478392.042528:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964387072:0@lo:400: 00010000:00080000:1.0:1789478392.042537:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb035a6d80 x1876403964387584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478392.042544:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964387584:0@lo:400: 00010000:00080000:1.0:1789478392.042579:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03352680 x1876403964386432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478392.042587:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03352680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964386432:0@lo:400: 00010000:00080000:1.0:1789478392.042614:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb035a7100 x1876403964386944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478392.042633:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964386944:0@lo:400: 00010000:00080000:1.0:1789478392.042645:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb035a7800 x1876403964387456/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478392.042651:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964387456:0@lo:400: 00010000:00080000:1.0:1789478392.042660:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03353b80 x1876403964386816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478392.042666:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964386816:0@lo:400: 00010000:00080000:1.0:1789478392.042673:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb035a5180 x1876403964387328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478392.042680:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964387328:0@lo:400: 00000100:00100000:3.0:1789478392.046447:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789478392.046464:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+15:3645:x1876403964386304:12345-0@lo:400: 00000100:00100000:3.0:1789478392.046558:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+15:3645:x1876403964386304:12345-0@lo:400: Request processed in 100us (5548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478392.046565:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789478392.047342:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964386304:0@lo:400: 00000001:02000400:3.0:1789478392.094166:0:9871:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789478392.357329:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478392.548805:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789478392.548826:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964387712:0@lo:13: 00000100:00100000:2.0:1789478392.548884:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478392.549001:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964387712 00000100:00100000:0.0:1789478392.549007:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964387712 00000100:00100000:0.0:1789478392.549054:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789478392.549062:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964387712:12345-0@lo:13: 00002000:00000024:0.0:1789478392.549087:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478392.549137:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964387712:12345-0@lo:13: Request processed in 75us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478392.549144:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789478392.549204:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c896d80 x1876403964387712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478392.549223:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964387712:0@lo:13: 00000020:00000004:1.0:1789478392.775954:0:9923:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789478392.776468:0:9923:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789478393.061444:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789478393.061467:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964387840:0@lo:13: 00000100:00100000:2.0:1789478393.061521:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478393.061660:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964387840 00000100:00100000:1.0:1789478393.061668:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964387840 00000100:00100000:1.0:1789478393.061703:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789478393.061711:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964387840:12345-0@lo:13: 00002000:00000024:1.0:1789478393.061729:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789478393.061776:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964387840:12345-0@lo:13: Request processed in 66us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478393.061782:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789478393.061920:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb035a5180 x1876403964387840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478393.061936:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964387840:0@lo:13: 00010000:00010000:1.0:1789478393.380736:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478394.404884:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478394.598796:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964387968:0@lo:41: 00000100:00100000:1.0:1789478394.598891:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1789478394.599229:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789478394.599234:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ebc40e0d800 from 39 10000000:01000000:2.0:1789478394.599238:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789478394.599277:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215cc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478394.599289:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215cc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478394.599310:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215cc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478394.599327:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964388096:0@lo:101: 00000100:00100000:2.0:1789478394.599365:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478394.599416:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02bf6480 going to sleep for 11 seconds 00000100:00100000:1.0:1789478394.600524:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964387968 00000100:00100000:2.0:1789478394.600721:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964388224:0@lo:41: 00000100:00100000:2.0:1789478394.600775:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.600845:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964387968 00000100:00100000:1.0:1789478394.600905:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964388224 00000100:00100000:1.0:1789478394.600908:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964388224 00000100:00100000:1.0:1789478394.600927:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789478394.600953:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964387968:12345-0@lo:41: 00000004:00000024:1.0:1789478394.600995:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1789478394.601049:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964387968:12345-0@lo:41: Request processed in 113us (2159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.601057:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789478394.601075:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789478394.601081:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964388224:12345-0@lo:41: 00000004:00000024:1.0:1789478394.601098:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789478394.601127:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964388224:12345-0@lo:41: Request processed in 46us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.601134:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789478394.601153:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964388096 00000100:00100000:1.0:1789478394.601157:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964388096 00000100:00100000:1.0:1789478394.601185:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789478394.601192:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+15:6514:x1876403964388096:12345-0@lo:101: 00010000:00010000:1.0:1789478394.601201:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478394.601220:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc42177000/0x8ebaae74e8215cca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215cc3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.601247:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc42177000/0x8ebaae74e8215cca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215cc3 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.601276:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc42177000/0x8ebaae74e8215cca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215cc3 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.601287:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc42177000, rc 0) 00000100:00100000:1.0:1789478394.601333:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:6514:x1876403964388096:12345-0@lo:101: Request processed in 142us (1968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.601339:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789478394.601402:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964388224:0@lo:41: 00000100:00100000:1.0:1789478394.601431:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964387968:0@lo:41: 00000100:00100000:1.0:1789478394.603296:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964388096:0@lo:101: 00010000:00010000:1.0:1789478394.603340:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215cc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215cca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.603353:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215cc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215cca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478394.604838:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964388352:0@lo:501: 00000100:00100000:1.0:1789478394.604921:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.609279:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb027d1780 going to sleep for 11 seconds 00000100:00100000:0.0:1789478394.609608:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964388352 00000100:00100000:0.0:1789478394.609621:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964388352 00000100:00100000:0.0:1789478394.609688:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789478394.609699:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:6514:x1876403964388352:12345-0@lo:501: 00000100:00100000:0.0:1789478394.609910:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:6514:x1876403964388352:12345-0@lo:501: Request processed in 213us (4989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478394.609918:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789478394.610102:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964388352:0@lo:501: 00000100:00100000:1.0:1789478394.610166:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964388480:0@lo:503: 00000100:00100000:1.0:1789478394.610228:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.610267:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb027d1780 going to sleep for 11 seconds 00000100:00100000:3.0:1789478394.610329:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964388480 00000100:00100000:3.0:1789478394.610334:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964388480 00000100:00100000:3.0:1789478394.610370:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789478394.610378:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+16:6514:x1876403964388480:12345-0@lo:503: 00000100:00100000:3.0:1789478394.610492:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+16:6514:x1876403964388480:12345-0@lo:503: Request processed in 115us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478394.610499:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789478394.610703:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964388480:0@lo:503: 00000100:00100000:1.0:1789478394.611374:0:9984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035a7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:9984:1876403964388608:0@lo:502: 00000100:00100000:1.0:1789478394.611545:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.611622:0:9984:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb027d1600 going to sleep for 11 seconds 00000100:00100000:3.0:1789478394.611728:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964388608 00000100:00100000:3.0:1789478394.611734:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964388608 00000100:00100000:3.0:1789478394.611777:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789478394.611799:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:9984:x1876403964388608:12345-0@lo:502: 00000100:00100000:3.0:1789478394.611921:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:9984:x1876403964388608:12345-0@lo:502: Request processed in 127us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478394.611929:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789478394.612402:0:9984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035a7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:9984:1876403964388608:0@lo:502: 00000100:00100000:1.0:1789478394.612666:0:9984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035a7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:9984:1876403964388736:0@lo:502: 00000100:00100000:1.0:1789478394.612721:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.612747:0:9984:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb027d1600 going to sleep for 11 seconds 00000100:00100000:3.0:1789478394.613360:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964388736 00000100:00100000:3.0:1789478394.613367:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964388736 00000100:00100000:3.0:1789478394.613427:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789478394.613634:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:9984:x1876403964388736:12345-0@lo:502: 00000100:00100000:3.0:1789478394.613785:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:9984:x1876403964388736:12345-0@lo:502: Request processed in 349us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478394.613793:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789478394.614569:0:9984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035a7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:9984:1876403964388736:0@lo:502: 00000040:00080000:1.0:1789478394.614643:0:9984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789478394.615369:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789478394.615407:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789478394.615422:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215cc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215cca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478394.615436:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215cc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215cca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478394.615639:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789478394.615642:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1789478394.615646:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789478394.615693:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec200/0x8ebaae74e8215cd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478394.615701:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec200/0x8ebaae74e8215cd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478394.615712:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec200/0x8ebaae74e8215cd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478394.615755:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964388864:0@lo:101: 00000100:00100000:3.0:1789478394.615835:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478394.615887:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789478394.615912:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964388864 00000100:00100000:3.0:1789478394.615921:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964388864 00000100:00100000:3.0:1789478394.615990:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789478394.616003:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+16:6514:x1876403964388864:12345-0@lo:101: 00010000:00010000:3.0:1789478394.616016:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478394.616031:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215cd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215cd1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478394.616056:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215cd1 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478394.616066:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215cd1 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478394.616075:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc421eca00, rc 0) 00000100:00100000:3.0:1789478394.616131:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+17:6514:x1876403964388864:12345-0@lo:101: Request processed in 132us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478394.616137:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789478394.617406:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964388864:0@lo:101: 00010000:00010000:2.0:1789478394.617438:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec200/0x8ebaae74e8215cd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215cd8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478394.617464:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec200/0x8ebaae74e8215cd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215cd8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478394.617562:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964388992:0@lo:501: 00000100:00100000:2.0:1789478394.617633:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478394.617681:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02bf6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789478394.617732:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964388992 00000100:00100000:1.0:1789478394.617747:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964388992 00000100:00100000:1.0:1789478394.617811:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789478394.617821:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+17:6514:x1876403964388992:12345-0@lo:501: 00000100:00100000:1.0:1789478394.618023:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+17:6514:x1876403964388992:12345-0@lo:501: Request processed in 201us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.618035:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789478394.618060:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964388992:0@lo:501: 00000100:00100000:2.0:1789478394.618102:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964389120:0@lo:503: 00000100:00100000:2.0:1789478394.618158:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478394.618188:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02bf6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789478394.618482:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964389120 00000100:00100000:1.0:1789478394.618489:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964389120 00000100:00100000:1.0:1789478394.618526:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789478394.618534:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+17:6514:x1876403964389120:12345-0@lo:503: 00000100:00100000:1.0:1789478394.618681:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+17:6514:x1876403964389120:12345-0@lo:503: Request processed in 147us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.618692:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789478394.618708:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964389120:0@lo:503: 00000100:00100000:3.0:1789478394.622882:0:9987:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f62d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:9987:1876403964389248:0@lo:502: 00000100:00100000:3.0:1789478394.623012:0:9987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478394.623060:0:9987:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789478394.623161:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964389248 00000100:00100000:0.0:1789478394.623171:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964389248 00000100:00100000:0.0:1789478394.623298:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789478394.623404:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+17:9987:x1876403964389248:12345-0@lo:502: 00000100:00100000:0.0:1789478394.623918:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+17:9987:x1876403964389248:12345-0@lo:502: Request processed in 516us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478394.623955:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789478394.624045:0:9987:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f62d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:9987:1876403964389248:0@lo:502: 00000020:01000000:3.0:1789478394.624092:0:9987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789478394.624103:0:9987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478394.624106:0:9987:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789478394.624111:0:9987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789478394.624114:0:9987:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789478394.624140:0:9987:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f62d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:9987:1876403964389376:0@lo:502: 00000100:00100000:3.0:1789478394.624179:0:9987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478394.624373:0:9987:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789478394.624407:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964389376 00000100:00100000:0.0:1789478394.624413:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964389376 00000100:00100000:0.0:1789478394.624556:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789478394.624565:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+17:9987:x1876403964389376:12345-0@lo:502: 00000100:00100000:0.0:1789478394.624681:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+17:9987:x1876403964389376:12345-0@lo:502: Request processed in 116us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478394.624688:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789478394.624903:0:9987:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f62d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:9987:1876403964389376:0@lo:502: 00000020:01000000:3.0:1789478394.624926:0:9987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789478394.624931:0:9987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478394.624933:0:9987:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789478394.625754:0:9987:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789478394.625862:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789478394.625913:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789478394.625925:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec200/0x8ebaae74e8215cd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215cd8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478394.625951:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec200/0x8ebaae74e8215cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215cd8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478394.625963:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789478394.625966:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ebc34d64800 from 39 10000000:01000000:0.0:1789478394.625969:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789478394.626012:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8215cdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478394.626020:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8215cdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478394.626032:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8215cdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478394.626055:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c894a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964389504:0@lo:101: 00000100:00100000:0.0:1789478394.626127:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478394.626977:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0263f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478394.627761:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964389504 00000100:00100000:1.0:1789478394.627834:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964389504 00000100:00100000:1.0:1789478394.627908:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789478394.627950:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+17:6514:x1876403964389504:12345-0@lo:101: 00010000:00010000:1.0:1789478394.627971:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478394.627994:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc42176c00/0x8ebaae74e8215ce6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215cdf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.628027:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc42176c00/0x8ebaae74e8215ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215cdf expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.628040:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc42176c00/0x8ebaae74e8215ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215cdf expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.628051:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc42176c00, rc 0) 00000100:00100000:1.0:1789478394.628144:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964389504:12345-0@lo:101: Request processed in 211us (2017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.628152:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789478394.628207:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c894a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964389504:0@lo:101: 00010000:00010000:0.0:1789478394.628232:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8215cdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215ce6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478394.628243:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8215cdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215ce6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478394.628331:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c894a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964389632:0@lo:501: 00000100:00100000:0.0:1789478394.628381:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.628772:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964389632 00000100:00100000:1.0:1789478394.628781:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964389632 00000100:00100000:0.0:1789478394.628800:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0263f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478394.628834:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789478394.628845:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964389632:12345-0@lo:501: 00000100:00100000:1.0:1789478394.629029:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964389632:12345-0@lo:501: Request processed in 186us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.629037:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789478394.629137:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c894a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964389632:0@lo:501: 00000100:00100000:0.0:1789478394.629189:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c894a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964389760:0@lo:503: 00000100:00100000:0.0:1789478394.629241:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478394.629269:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0263f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478394.629312:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964389760 00000100:00100000:1.0:1789478394.629317:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964389760 00000100:00100000:1.0:1789478394.629345:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789478394.629354:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964389760:12345-0@lo:503: 00000100:00100000:1.0:1789478394.629583:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964389760:12345-0@lo:503: Request processed in 229us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.629630:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789478394.629763:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c894a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964389760:0@lo:503: 00000100:00100000:1.0:1789478394.630080:0:9989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035a7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:9989:1876403964389888:0@lo:502: 00000100:00100000:1.0:1789478394.630135:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.630202:0:9989:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb027d1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789478394.630237:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964389888 00000100:00100000:0.0:1789478394.630243:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964389888 00000100:00100000:0.0:1789478394.630313:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789478394.630322:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+18:9989:x1876403964389888:12345-0@lo:502: 00000100:00100000:0.0:1789478394.630514:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+18:9989:x1876403964389888:12345-0@lo:502: Request processed in 192us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478394.630523:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789478394.630629:0:9989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035a7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:9989:1876403964389888:0@lo:502: 00000100:00100000:1.0:1789478394.630698:0:9989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035a7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:9989:1876403964390016:0@lo:502: 00000100:00100000:1.0:1789478394.630738:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.630766:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964390016 00000100:00100000:1.0:1789478394.630770:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964390016 00000100:00100000:1.0:1789478394.630795:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789478394.630803:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+18:9989:x1876403964390016:12345-0@lo:502: 00000100:00100000:1.0:1789478394.630871:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+18:9989:x1876403964390016:12345-0@lo:502: Request processed in 69us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.630878:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789478394.630914:0:9989:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb027d1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789478394.630927:0:9989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035a7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:9989:1876403964390016:0@lo:502: 00000040:00080000:1.0:1789478394.630958:0:9989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1789478394.631205:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1789478394.631231:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789478394.631249:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8215cdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215ce6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478394.631262:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8215cdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215ce6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478394.631273:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789478394.631275:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ebc34d64800 from 6 10000000:01000000:0.0:1789478394.631278:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789478394.631311:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66c00/0x8ebaae74e8215ced lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478394.631320:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66c00/0x8ebaae74e8215ced lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478394.631330:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66c00/0x8ebaae74e8215ced lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478394.631344:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c894a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964390144:0@lo:101: 00000100:00100000:0.0:1789478394.631379:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478394.631507:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0263fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789478394.631543:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964390144 00000100:00100000:1.0:1789478394.631548:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964390144 00000100:00100000:1.0:1789478394.631962:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789478394.631972:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964390144:12345-0@lo:101: 00010000:00010000:1.0:1789478394.631986:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478394.632004:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc42177800/0x8ebaae74e8215cf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215ced expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.632029:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc42177800/0x8ebaae74e8215cf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215ced expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.632048:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc42177800/0x8ebaae74e8215cf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215ced expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.632057:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc42177800, rc 0) 00000100:00100000:1.0:1789478394.632110:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+19:6514:x1876403964390144:12345-0@lo:101: Request processed in 136us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.632118:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789478394.632213:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c894a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964390144:0@lo:101: 00010000:00010000:1.0:1789478394.632229:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66c00/0x8ebaae74e8215ced lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215cf4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.632239:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66c00/0x8ebaae74e8215ced lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215cf4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478394.632295:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964390272:0@lo:256: 00000100:00100000:1.0:1789478394.632331:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.632410:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb027d1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789478394.632500:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964390272 00000100:00100000:0.0:1789478394.632506:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964390272 00000100:00100000:0.0:1789478394.632574:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789478394.632581:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+19:6514:x1876403964390272:12345-0@lo:256: 20000000:01000000:0.0:1789478394.632687:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789478394.632707:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789478394.632710:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1789478394.632791:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+19:6514:x1876403964390272:12345-0@lo:256: Request processed in 209us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478394.632809:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789478394.632881:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964390272:0@lo:256: 10000000:01000000:1.0:1789478394.632927:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789478394.632944:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66c00/0x8ebaae74e8215ced lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215cf4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.632953:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66c00/0x8ebaae74e8215ced lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215cf4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478394.632961:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789478394.632968:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1789478394.632971:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789478394.633004:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcee00/0x8ebaae74e8215cfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.633012:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcee00/0x8ebaae74e8215cfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.633020:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcee00/0x8ebaae74e8215cfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478394.633032:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964390400:0@lo:101: 00000100:00100000:1.0:1789478394.633057:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.633077:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb027d1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789478394.633089:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964390400 00000100:00100000:1.0:1789478394.633092:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964390400 00000100:00100000:1.0:1789478394.633114:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789478394.633120:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+19:6514:x1876403964390400:12345-0@lo:101: 00010000:00010000:1.0:1789478394.633129:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478394.633142:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40fcf200/0x8ebaae74e8215d02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215cfb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.633157:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40fcf200/0x8ebaae74e8215d02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215cfb expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.633167:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40fcf200/0x8ebaae74e8215d02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215cfb expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.633173:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcf200, rc 0) 00000100:00100000:1.0:1789478394.633198:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+20:6514:x1876403964390400:12345-0@lo:101: Request processed in 78us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.633209:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789478394.633241:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964390400:0@lo:101: 00010000:00010000:1.0:1789478394.633252:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcee00/0x8ebaae74e8215cfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215d02 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.633260:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcee00/0x8ebaae74e8215cfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215d02 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478394.633311:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964390528:0@lo:501: 00000100:00100000:1.0:1789478394.633334:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.633346:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb027d1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789478394.633357:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964390528 00000100:00100000:1.0:1789478394.633360:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964390528 00000100:00100000:1.0:1789478394.633380:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789478394.633457:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+20:6514:x1876403964390528:12345-0@lo:501: 00000100:00100000:1.0:1789478394.633576:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+20:6514:x1876403964390528:12345-0@lo:501: Request processed in 190us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.633583:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789478394.633698:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964390528:0@lo:501: 00000100:00100000:1.0:1789478394.633723:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964390656:0@lo:503: 00000100:00100000:1.0:1789478394.633759:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.633777:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb027d1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789478394.633787:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964390656 00000100:00100000:1.0:1789478394.633791:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964390656 00000100:00100000:1.0:1789478394.633813:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789478394.633818:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10002850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+20:6514:x1876403964390656:12345-0@lo:503: 00000100:00100000:1.0:1789478394.633901:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10002850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+20:6514:x1876403964390656:12345-0@lo:503: Request processed in 82us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.633908:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789478394.633954:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964390656:0@lo:503: 00000100:00100000:0.0:1789478394.634808:0:9990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c894700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:9990:1876403964390784:0@lo:502: 00000100:00100000:0.0:1789478394.634864:0:9990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.634881:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964390784 00000100:00100000:1.0:1789478394.634887:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964390784 00000100:00100000:0.0:1789478394.634892:0:9990:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0263fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789478394.634920:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789478394.634930:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10001050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+20:9990:x1876403964390784:12345-0@lo:502: 00000100:00100000:1.0:1789478394.635044:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10001050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+20:9990:x1876403964390784:12345-0@lo:502: Request processed in 115us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.635051:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789478394.635055:0:9990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c894700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:9990:1876403964390784:0@lo:502: 00000020:01000000:0.0:1789478394.635078:0:9990:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789478394.635086:0:9990:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789478394.635095:0:9990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478394.635098:0:9990:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789478394.635104:0:9990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789478394.635108:0:9990:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:01000000:0.0:1789478394.635133:0:9990:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789478394.635136:0:9990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789478394.635163:0:9990:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8ebc40f719b8) 00000020:00000080:0.0:1789478394.635191:0:9990:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1789478394.635197:0:9990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789478394.635306:0:9990:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1789478394.635312:0:9990:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789478394.635321:0:9990:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8ebaae74e8215d10 00010000:00080000:0.0:1789478394.635354:0:9990:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ebc3c8a8000@lustre-OST0001-osc-MDT0001: add connection 192.168.206.111@tcp at head 00010000:00010000:0.0:1789478394.635719:0:9990:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1789478394.635880:0:9990:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789478394.635894:0:9990:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789478394.636127:0:9990:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789478394.636231:0:9990:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789478394.636382:0:9990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789478394.636569:0:9990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1789478394.639834:0:9991:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789478394.639844:0:9991:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789478394.640792:0:9990:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789478394.640808:0:9990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789478394.640857:0:9990:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789478394.640887:0:9990:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8ebaae74e8215d17 00000100:00080000:0.0:1789478394.640901:0:9990:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789478394.640916:0:9990:0:(import.c:625:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ebc3c8a8000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1789478394.640976:0:9990:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebc3c894700 x1876403964390912/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789478394.641013:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964390912:0@lo:8: 00000100:00100000:0.0:1789478394.641115:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789478394.641205:0:9990:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789478394.641361:0:9990:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789478394.641366:0:9990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478394.641369:0:9990:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789478394.641373:0:9990:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789478394.641378:0:9990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478394.641379:0:9990:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789478394.641382:0:9990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789478394.641384:0:9990:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789478394.641586:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964390912 00000100:00100000:1.0:1789478394.641621:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964390912 00000100:00100000:1.0:1789478394.641662:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789478394.641671:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c894a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1876403964390912:12345-0@lo:8: 00010000:00080000:1.0:1789478394.641706:0:8829:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:1.0:1789478394.641743:0:8829:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8ebaae74e8215d1e 00002000:00100000:1.0:1789478394.641762:0:8829:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8ebc3f6c4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1789478394.641767:0:8829:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1789478394.641771:0:8829:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789478394.641854:0:8829:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789478394.642160:0:8829:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1789478394.642193:0:8829:0:(import.c:65:import_set_state_nolock()) ffff8ebc3f6c3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789478394.642274:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c894a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3644:x1876403964390912:12345-0@lo:8: Request processed in 603us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.642283:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789478394.642320:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876403964391040:0@lo:400: 00000100:00100000:1.0:1789478394.642359:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.642383:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964391552:0@lo:400: 00000100:00100000:1.0:1789478394.642773:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.642802:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789478394.642810:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876403964391424:0@lo:400: 00000100:00100000:1.0:1789478394.642834:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.642852:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876403964391936:0@lo:400: 00000100:00100000:1.0:1789478394.642874:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.642917:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964391168:0@lo:400: 00000100:00100000:1.0:1789478394.642951:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.642965:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964391680:0@lo:400: 00000100:00100000:1.0:1789478394.642982:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.643001:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789478394.643006:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964391296:0@lo:400: 00000100:00100000:1.0:1789478394.643027:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.643038:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964391808:0@lo:400: 00000100:00100000:1.0:1789478394.643056:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.643083:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964391552 00000100:00100000:1.0:1789478394.643089:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964391552 00000100:00100000:1.0:1789478394.643132:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964391680 00000100:00100000:1.0:1789478394.643135:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964391680 00000100:00100000:1.0:1789478394.643151:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789478394.643160:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964391552:12345-0@lo:400: 00000100:00100000:1.0:1789478394.643205:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964391552:12345-0@lo:400: Request processed in 46us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.643224:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789478394.643239:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789478394.643245:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964391680:12345-0@lo:400: 00000100:00100000:1.0:1789478394.643278:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964391680:12345-0@lo:400: Request processed in 34us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.643284:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789478394.643303:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964391040 00000100:00100000:1.0:1789478394.643308:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964391040 00000100:00100000:1.0:1789478394.643326:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964391424 00000100:00100000:1.0:1789478394.643328:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964391424 00000100:00100000:1.0:1789478394.643341:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964391936 00000100:00100000:1.0:1789478394.643344:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964391936 00000100:00100000:1.0:1789478394.643356:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964391168 00000100:00100000:1.0:1789478394.643360:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964391168 00000100:00100000:1.0:1789478394.643370:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964391296 00000100:00100000:1.0:1789478394.643373:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964391296 00000100:00100000:1.0:1789478394.643385:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964391808 00000100:00100000:0.0:1789478394.643589:0:9990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c961f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:9990:1876403964392064:0@lo:502: 00000100:00100000:0.0:1789478394.643721:0:9990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478394.643752:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964392064 00000100:00100000:0.0:1789478394.643756:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964392064 00000100:00100000:0.0:1789478394.643786:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789478394.643793:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+20:9990:x1876403964392064:12345-0@lo:502: 00000100:00100000:0.0:1789478394.643910:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+20:9990:x1876403964392064:12345-0@lo:502: Request processed in 116us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478394.643917:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789478394.643988:0:9990:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0263f540 going to sleep for 11 seconds 00000100:00100000:0.0:1789478394.644011:0:9990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c961f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:9990:1876403964392064:0@lo:502: 00000020:01000000:0.0:1789478394.644039:0:9990:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789478394.644048:0:9990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478394.644050:0:9990:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789478394.644055:0:9990:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:1.0:1789478394.645506:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964391808 00000100:00100000:1.0:1789478394.646132:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789478394.646149:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876403964391040:12345-0@lo:400: 00000100:00100000:1.0:1789478394.646271:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876403964391040:12345-0@lo:400: Request processed in 127us (3910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.646279:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789478394.646299:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789478394.646307:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876403964391424:12345-0@lo:400: 00000100:00100000:1.0:1789478394.646340:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876403964391424:12345-0@lo:400: Request processed in 35us (3505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.646347:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789478394.646369:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789478394.646376:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876403964391936:12345-0@lo:400: 00000100:00100000:1.0:1789478394.646567:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876403964391936:12345-0@lo:400: Request processed in 191us (3691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.646574:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789478394.646588:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789478394.646689:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964391168:12345-0@lo:400: 00000100:00100000:1.0:1789478394.646751:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964391168:12345-0@lo:400: Request processed in 66us (3798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.646763:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789478394.646790:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789478394.646799:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964391296:12345-0@lo:400: 00000100:00100000:1.0:1789478394.646835:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964391296:12345-0@lo:400: Request processed in 37us (3805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.646843:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789478394.646857:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789478394.646864:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964391808:12345-0@lo:400: 00000100:00100000:1.0:1789478394.646893:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964391808:12345-0@lo:400: Request processed in 30us (3835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.646899:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1789478394.646952:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789478394.646957:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789478394.646961:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000000:1.0:1789478394.646972:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1789478394.647005:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789478394.647022:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcee00/0x8ebaae74e8215cfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215d02 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.647045:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcee00/0x8ebaae74e8215cfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215d02 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478394.647057:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789478394.647060:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ebc0501d800 from 39 10000000:01000000:1.0:1789478394.647064:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789478394.647103:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf000/0x8ebaae74e8215d25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.647112:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf000/0x8ebaae74e8215d25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.647125:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf000/0x8ebaae74e8215d25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478394.647147:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03353b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964392192:0@lo:101: 00000100:00100000:1.0:1789478394.647189:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.647235:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb027d13c0 going to sleep for 11 seconds 00010000:00080000:1.0:1789478394.647291:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c897100 x1876403964391296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478394.647307:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964391296:0@lo:400: 00010000:00080000:1.0:1789478394.647322:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c960a80 x1876403964391808/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478394.647330:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964391808:0@lo:400: 00000100:00100000:0.0:1789478394.648521:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964392192 00000100:00100000:0.0:1789478394.648539:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964392192 00000100:00100000:0.0:1789478394.648636:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789478394.648649:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+20:6514:x1876403964392192:12345-0@lo:101: 00010000:00010000:0.0:1789478394.648668:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478394.648691:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc35b67200/0x8ebaae74e8215d2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215d25 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478394.648726:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc35b67200/0x8ebaae74e8215d2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215d25 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478394.648742:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc35b67200/0x8ebaae74e8215d2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215d25 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478394.648753:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b67200, rc 0) 00000100:00100000:0.0:1789478394.648840:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964392192:12345-0@lo:101: Request processed in 194us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478394.648848:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00010000:00080000:1.0:1789478394.650763:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c897800 x1876403964391168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478394.650799:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964391168:0@lo:400: 00010000:00080000:1.0:1789478394.650819:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c960e00 x1876403964391680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478394.650828:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964391680:0@lo:400: 00000100:00100000:1.0:1789478394.650886:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03353b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964392192:0@lo:101: 00010000:00010000:1.0:1789478394.650910:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf000/0x8ebaae74e8215d25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215d2c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.650923:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf000/0x8ebaae74e8215d25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215d2c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478394.651022:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03353b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964392320:0@lo:501: 00000100:00100000:1.0:1789478394.651088:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.651135:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb027d13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478394.651152:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964392320 00000100:00100000:1.0:1789478394.651157:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964392320 00000100:00100000:1.0:1789478394.651200:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789478394.651209:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964392320:12345-0@lo:501: 00000100:00100000:1.0:1789478394.651356:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964392320:12345-0@lo:501: Request processed in 146us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.651366:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789478394.652541:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03353b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964392320:0@lo:501: 00000100:00100000:1.0:1789478394.653460:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03353b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964392448:0@lo:503: 00000100:00100000:1.0:1789478394.653556:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.653642:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb027d13c0 going to sleep for 11 seconds 00010000:00080000:1.0:1789478394.653700:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c894700 x1876403964390912/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789478404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478394.653713:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789478394.653725:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789478394.653737:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789478394.653745:0:3644:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789478394.653750:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc3c8a8000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789478394.653783:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789478394.653790:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964390912:0@lo:8: 00010000:00080000:1.0:1789478394.653842:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40ecdc00 x1876403964391424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478394.653853:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876403964391424:0@lo:400: 00010000:00080000:1.0:1789478394.653867:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c960380 x1876403964391936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478394.653875:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876403964391936:0@lo:400: 00010000:00080000:1.0:1789478394.653887:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c896d80 x1876403964391040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478394.653894:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876403964391040:0@lo:400: 00010000:00080000:1.0:1789478394.653906:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40ecea00 x1876403964391552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478394.653914:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964391552:0@lo:400: 00000100:00100000:1.0:1789478394.653957:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964392448 00000100:00100000:1.0:1789478394.653964:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964392448 00000100:00100000:1.0:1789478394.654016:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789478394.654033:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964392448:12345-0@lo:503: 00000100:00100000:1.0:1789478394.654190:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964392448:12345-0@lo:503: Request processed in 157us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.654199:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789478394.654254:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03353b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964392448:0@lo:503: 00000004:00080000:0.0:1789478394.654643:0:9991:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789478394.654734:0:9991:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 223770138953ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789478394.654744:0:9991:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1789478394.657085:0:7448:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1789478394.657187:0:9992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c961f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9992:1876403964392576:0@lo:700: 00000100:00100000:0.0:1789478394.657288:0:9992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478394.660097:0:9992:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0263f240 going to sleep for 11 seconds 00000100:00100000:1.0:1789478394.663395:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964392576 00000100:00100000:1.0:1789478394.663417:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964392576 00000100:00100000:1.0:1789478394.663523:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789478394.663536:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9992:x1876403964392576:12345-0@lo:700: 00000100:00100000:1.0:1789478394.663649:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03353b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8439:1876403964392704:0@lo:700: 00000100:00100000:1.0:1789478394.663729:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.663765:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb027d13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478394.665040:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964392704 00000100:00100000:3.0:1789478394.665052:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964392704 00000100:00100000:3.0:1789478394.665097:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789478394.665105:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8439:x1876403964392704:12345-0@lo:700: 00000100:00080000:0.0:1789478394.666331:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789478394.668147:0:9994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03350000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:9994:1876403964392832:0@lo:502: 00000100:00100000:1.0:1789478394.668485:0:9994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.668548:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964392832 00000100:00100000:1.0:1789478394.668558:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964392832 00000100:00100000:1.0:1789478394.668650:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789478394.668664:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+21:9994:x1876403964392832:12345-0@lo:502: 00000100:00100000:1.0:1789478394.668832:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+21:9994:x1876403964392832:12345-0@lo:502: Request processed in 172us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.668842:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789478394.668931:0:9994:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb027d1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478394.668971:0:9994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03350000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:9994:1876403964392832:0@lo:502: 00000100:00100000:1.0:1789478394.669048:0:9994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03350000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:9994:1876403964392960:0@lo:502: 00000100:00100000:1.0:1789478394.669098:0:9994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.669147:0:9994:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb027d1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478394.671343:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964392960 00000100:00100000:0.0:1789478394.671361:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964392960 00000100:00100000:3.0:1789478394.673784:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789478394.673804:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10000850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+21:9994:x1876403964392960:12345-0@lo:502: 00000100:00100000:3.0:1789478394.674063:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10000850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+21:9994:x1876403964392960:12345-0@lo:502: Request processed in 264us (4965us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478394.674072:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789478394.674694:0:9994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03350000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:9994:1876403964392960:0@lo:502: 00000040:00080000:0.0:1789478394.674744:0:9994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789478394.675773:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789478394.675812:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789478394.675826:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf000/0x8ebaae74e8215d25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215d2c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478394.675840:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf000/0x8ebaae74e8215d25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215d2c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478394.675868:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789478394.675871:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ebc0501d800 from 6 10000000:01000000:3.0:1789478394.675874:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789478394.675921:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed000/0x8ebaae74e8215d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478394.675930:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed000/0x8ebaae74e8215d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478394.675955:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed000/0x8ebaae74e8215d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478394.675986:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964393088:0@lo:101: 00000100:00100000:3.0:1789478394.676065:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478394.676117:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f2900 going to sleep for 11 seconds 00000100:00100000:0.0:1789478394.676195:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964393088 00000100:00100000:0.0:1789478394.676205:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964393088 00000100:00100000:0.0:1789478394.676255:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789478394.676266:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964393088:12345-0@lo:101: 00010000:00010000:0.0:1789478394.676280:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478394.676295:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc35b67800/0x8ebaae74e8215d3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215d33 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478394.676556:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc35b67800/0x8ebaae74e8215d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215d33 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478394.676568:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc35b67800/0x8ebaae74e8215d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215d33 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478394.676578:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b67800, rc 0) 00000100:00100000:0.0:1789478394.676649:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964393088:12345-0@lo:101: Request processed in 384us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478394.676656:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789478394.677094:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964393088:0@lo:101: 00010000:00010000:3.0:1789478394.677114:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed000/0x8ebaae74e8215d33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215d3a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478394.677125:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed000/0x8ebaae74e8215d33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215d3a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478394.677198:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964393216:0@lo:256: 00000100:00100000:3.0:1789478394.677238:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478394.677266:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f2900 going to sleep for 11 seconds 00000100:00100000:3.0:1789478394.677287:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964393216 00000100:00100000:3.0:1789478394.677291:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964393216 00000100:00100000:3.0:1789478394.678516:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789478394.678546:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964393216:12345-0@lo:256: 20000000:01000000:3.0:1789478394.678574:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789478394.678621:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789478394.678625:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789478394.678765:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964393216:12345-0@lo:256: Request processed in 220us (1522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478394.678774:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789478394.678869:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964393216:0@lo:256: 10000000:01000000:3.0:1789478394.678926:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789478394.678947:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed000/0x8ebaae74e8215d33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215d3a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478394.678957:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed000/0x8ebaae74e8215d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215d3a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478394.678969:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789478394.678972:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1789478394.678975:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789478394.679010:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc421edc00/0x8ebaae74e8215d41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478394.679019:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc421edc00/0x8ebaae74e8215d41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478394.679193:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc421edc00/0x8ebaae74e8215d41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478394.679220:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964393344:0@lo:101: 00000100:00100000:3.0:1789478394.679261:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478394.679323:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f2900 going to sleep for 11 seconds 00000100:00100000:0.0:1789478394.679393:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964393344 00000100:00100000:0.0:1789478394.679401:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964393344 00000100:00100000:0.0:1789478394.679454:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789478394.679464:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964393344:12345-0@lo:101: 00010000:00010000:0.0:1789478394.679482:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478394.679499:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc35b67a00/0x8ebaae74e8215d48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215d41 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478394.679529:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc35b67a00/0x8ebaae74e8215d48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215d41 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478394.679540:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc35b67a00/0x8ebaae74e8215d48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215d41 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478394.679549:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b67a00, rc 0) 00000100:00100000:0.0:1789478394.679585:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964393344:12345-0@lo:101: Request processed in 123us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478394.679733:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964393344:0@lo:101: 00010000:00010000:3.0:1789478394.679746:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc421edc00/0x8ebaae74e8215d41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215d48 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478394.679755:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc421edc00/0x8ebaae74e8215d41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215d48 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478394.679819:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964393472:0@lo:501: 00000100:00100000:3.0:1789478394.679846:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478394.679869:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f2900 going to sleep for 11 seconds 00000100:00100000:3.0:1789478394.679881:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964393472 00000100:00100000:3.0:1789478394.679884:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964393472 00000100:00100000:0.0:1789478394.681311:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789478394.681470:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789478394.681485:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964393472:12345-0@lo:501: 00000100:00100000:3.0:1789478394.682313:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964393472:12345-0@lo:501: Request processed in 826us (2458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478394.682324:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789478394.682441:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964393472:0@lo:501: 00000100:00100000:0.0:1789478394.682514:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964393600:0@lo:503: 00000100:00100000:0.0:1789478394.682580:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478394.682652:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0263f300 going to sleep for 11 seconds 00000100:00100000:1.0:1789478394.685330:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964393600 00000100:00100000:1.0:1789478394.685344:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964393600 00000100:00100000:1.0:1789478394.685394:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789478394.685403:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964393600:12345-0@lo:503: 00000100:00100000:1.0:1789478394.685548:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964393600:12345-0@lo:503: Request processed in 145us (2967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.685555:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789478394.687021:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964393600:0@lo:503: 40000000:02000000:2.0:1789478394.687955:0:6524:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1789478394.694371:0:9996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c963b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:9996:1876403964393728:0@lo:502: 00000100:00100000:0.0:1789478394.694500:0:9996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478394.694559:0:9996:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05483540 going to sleep for 11 seconds 00000100:00100000:1.0:1789478394.694714:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964393728 00000100:00100000:1.0:1789478394.694724:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964393728 00000100:00100000:1.0:1789478394.694783:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789478394.694795:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+23:9996:x1876403964393728:12345-0@lo:502: 00000100:00100000:1.0:1789478394.694971:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+23:9996:x1876403964393728:12345-0@lo:502: Request processed in 177us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.694980:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789478394.695065:0:9996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c963b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:9996:1876403964393728:0@lo:502: 00000020:01000000:1.0:1789478394.695104:0:9996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789478394.695114:0:9996:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789478394.695123:0:9996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478394.695126:0:9996:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789478394.695132:0:9996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789478394.695137:0:9996:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:01000000:1.0:1789478394.695163:0:9996:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789478394.695166:0:9996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789478394.695198:0:9996:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ebc3f733370) 00000020:00000080:1.0:1789478394.695229:0:9996:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1789478394.695237:0:9996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789478394.695343:0:9996:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789478394.695350:0:9996:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1789478394.695359:0:9996:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ebaae74e8215d56 00010000:00080000:1.0:1789478394.695395:0:9996:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ebc359bd800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.111@tcp at head 00010000:00010000:1.0:1789478394.695704:0:9996:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1789478394.695878:0:9996:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789478394.695893:0:9996:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789478394.696110:0:9996:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789478394.696255:0:9996:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789478394.696415:0:9996:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789478394.696510:0:9996:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000100:00100000:2.0:1789478394.699675:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8439:x1876403964392704:12345-0@lo:700: Request processed in 34563us (35938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478394.699708:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789478394.699724:0:8439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03353b80 x1876403964392704/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789478410 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478394.699746:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03353b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8439:1876403964392704:0@lo:700: 40000000:02000000:0.0:1789478394.699768:0:8439:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:00080000:2.0:1789478394.703445:0:9997:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789478394.703454:0:9997:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789478394.706465:0:9996:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789478394.706479:0:9996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789478394.706522:0:9996:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789478394.706547:0:9996:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8ebaae74e8215d5d 00000100:00080000:2.0:1789478394.706558:0:9996:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789478394.706569:0:9996:0:(import.c:625:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ebc359bd800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1789478394.706765:0:9996:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb01b71f80 x1876403964393856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789478394.706787:0:9996:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789478394.707742:0:9996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789478394.707749:0:9996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478394.707751:0:9996:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789478394.707754:0:9996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789478394.707759:0:9996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478394.707760:0:9996:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789478394.707764:0:9996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789478394.707766:0:9996:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789478394.707801:0:9996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:9996:1876403964393984:0@lo:502: 00000100:00100000:2.0:1789478394.708114:0:9996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478394.708155:0:9996:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02bf6300 going to sleep for 11 seconds 00000100:00100000:2.0:1789478394.709721:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964393984 00000100:00100000:2.0:1789478394.709734:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964393984 00000100:00100000:2.0:1789478394.709800:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789478394.709821:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+23:9996:x1876403964393984:12345-0@lo:502: 00000100:00100000:2.0:1789478394.710383:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+23:9996:x1876403964393984:12345-0@lo:502: Request processed in 572us (2266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478394.710404:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789478394.710436:0:9996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:9996:1876403964393984:0@lo:502: 00000100:00100000:2.0:1789478394.710464:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964393856:0@lo:8: 00000020:01000000:3.0:1789478394.710475:0:9996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789478394.710495:0:9996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478394.710498:0:9996:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789478394.710506:0:9996:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:2.0:1789478394.710520:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478394.710581:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964393856 00000100:00100000:2.0:1789478394.710615:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964393856 00000020:01000000:1.0:1789478394.710634:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 00000100:00100000:2.0:1789478394.710650:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789478394.710660:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1876403964393856:12345-0@lo:8: 00010000:00080000:2.0:1789478394.710687:0:8431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 10000000:01000000:1.0:1789478394.710690:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789478394.710706:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc421edc00/0x8ebaae74e8215d41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215d48 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789478394.710716:0:8431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8ebaae74e8215d64 00010000:00010000:1.0:1789478394.710723:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc421edc00/0x8ebaae74e8215d41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215d48 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1789478394.710733:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8ebb034e3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 0 10000000:01000000:1.0:1789478394.710738:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 00002000:00080000:2.0:1789478394.710741:0:8431:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 10000000:01000000:1.0:1789478394.710744:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ebc08d93370 from 1 00002000:00100000:2.0:1789478394.710747:0:8431:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 10000000:01000000:1.0:1789478394.710749:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789478394.710797:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcfe00/0x8ebaae74e8215d6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.710806:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcfe00/0x8ebaae74e8215d6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.710818:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcfe00/0x8ebaae74e8215d6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1789478394.710829:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1789478394.710847:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03351180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964394112:0@lo:101: 00000100:00080000:2.0:1789478394.710857:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8ebb034e5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789478394.711362:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876403964393856:12345-0@lo:8: Request processed in 699us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478394.711370:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789478394.711581:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789478394.711648:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb01b71f80 x1876403964393856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789478404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478394.711661:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:1.0:1789478394.711670:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb027d13c0 going to sleep for 11 seconds 00000100:00080000:3.0:1789478394.711671:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789478394.711686:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789478394.711703:0:3644:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789478394.711706:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc359bd800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789478394.711719:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789478394.711725:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964393856:0@lo:8: 00000100:00100000:2.0:1789478394.711851:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964394112 00000100:00100000:2.0:1789478394.711858:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964394112 00000100:00100000:2.0:1789478394.711900:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789478394.711909:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964394112:12345-0@lo:101: 00010000:00010000:2.0:1789478394.711920:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478394.711948:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc34f76200/0x8ebaae74e8215d72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215d6b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478394.712101:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc34f76200/0x8ebaae74e8215d72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215d6b expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478394.712120:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc34f76200/0x8ebaae74e8215d72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215d6b expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478394.712129:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76200, rc 0) 00000100:00100000:2.0:1789478394.712180:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:6514:x1876403964394112:12345-0@lo:101: Request processed in 273us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478394.712187:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000004:00080000:2.0:1789478394.712470:0:9997:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789478394.713087:0:9997:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 223828490784ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789478394.713102:0:9997:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1789478394.713860:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03351180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964394112:0@lo:101: 00010000:00010000:1.0:1789478394.713887:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcfe00/0x8ebaae74e8215d6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215d72 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478394.713900:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcfe00/0x8ebaae74e8215d6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215d72 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478394.713999:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03351180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964394240:0@lo:501: 00000004:00080000:2.0:1789478394.714756:0:9999:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789478394.714776:0:9999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9999:1876403964394496:0@lo:7: 00000100:00100000:0.0:1789478394.716933:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964394368:0@lo:13: 00000100:00100000:2.0:1789478394.717463:0:9999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478394.717511:0:9999:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02bf66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478394.719902:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478394.719973:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.719987:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb027d13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478394.720042:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964394496 00000100:00100000:1.0:1789478394.720054:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964394496 00000100:00100000:1.0:1789478394.720146:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789478394.720159:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9999:x1876403964394496:12345-0@lo:7: 00000100:00100000:3.0:1789478394.720220:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964394368 00000100:00100000:3.0:1789478394.720231:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964394368 00000100:00100000:3.0:1789478394.720291:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789478394.720303:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1876403964394368:12345-0@lo:13: 00002000:00000024:3.0:1789478394.720420:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1789478394.720492:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1876403964394368:12345-0@lo:13: Request processed in 191us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478394.720501:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789478394.720661:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb01b71f80 x1876403964394368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478394.720684:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964394368:0@lo:13: 00000100:00100000:2.0:1789478394.721092:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964394240 00000100:00100000:2.0:1789478394.721098:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964394240 00000100:00100000:2.0:1789478394.721152:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789478394.721162:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:6514:x1876403964394240:12345-0@lo:501: 00000100:00100000:2.0:1789478394.721300:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:6514:x1876403964394240:12345-0@lo:501: Request processed in 132us (1400us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789478394.721310:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:2.0:1789478394.721781:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789478394.725961:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03351180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964394240:0@lo:501: 10000000:01000000:2.0:1789478394.726011:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789478394.726022:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcfe00/0x8ebaae74e8215d6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215d72 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478394.726044:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcfe00/0x8ebaae74e8215d6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215d72 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1789478394.727019:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789478394.727028:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1789478394.727135:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9992:x1876403964392576:12345-0@lo:700: Request processed in 63599us (69844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478394.727148:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789478394.727213:0:9992:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c961f80 x1876403964392576/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789478410 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478394.727225:0:9992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c961f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9992:1876403964392576:0@lo:700: 00000004:00080000:2.0:1789478394.728665:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:2.0:1789478394.730867:0:8430:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1789478394.730879:0:8430:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789478394.731018:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9999:x1876403964394496:12345-0@lo:7: Request processed in 10857us (13556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478394.731044:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789478394.732365:0:9999:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb01b71180 x1876403964394496/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789478410 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478394.732388:0:9999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9999:1876403964394496:0@lo:7: 00000004:00080000:3.0:1789478394.732420:0:9999:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789478394.732632:0:9999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f62300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9999:1876403964394624:0@lo:5: 00000100:00100000:3.0:1789478394.732699:0:9999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478394.732740:0:9999:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478394.733063:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964394624 00000100:00100000:2.0:1789478394.733140:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964394624 00000100:00100000:2.0:1789478394.733205:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789478394.733219:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9999:x1876403964394624:12345-0@lo:5: 00002000:00080000:2.0:1789478394.733249:0:8431:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789478394.733252:0:8431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789478394.733722:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9999:x1876403964394624:12345-0@lo:5: Request processed in 507us (1021us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789478394.733732:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789478394.734654:0:9999:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f62300 x1876403964394624/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789478410 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478394.734677:0:9999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f62300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9999:1876403964394624:0@lo:5: 00000004:00080000:3.0:1789478394.734696:0:9999:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789478394.734745:0:9999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f60a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9999:1876403964394752:0@lo:700: 00000100:00100000:3.0:1789478394.734807:0:9999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478394.734845:0:9999:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478394.734876:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964394752 00000100:00100000:0.0:1789478394.734886:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964394752 00000100:00100000:0.0:1789478394.734954:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789478394.734965:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9999:x1876403964394752:12345-0@lo:700: 00000004:00080000:1.0:1789478394.734997:0:9992:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789478394.735022:0:9992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03353b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9992:1876403964395008:0@lo:7: 00000100:00100000:1.0:1789478394.735182:0:9992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.735208:0:9992:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0263f240 going to sleep for 11 seconds 00000100:00100000:1.0:1789478394.735227:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964394880:0@lo:13: 00000100:00100000:1.0:1789478394.735261:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.735309:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964395008 00000100:00100000:1.0:1789478394.735316:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964395008 00000100:00100000:1.0:1789478394.735364:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789478394.735373:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9992:x1876403964395008:12345-0@lo:7: 00000100:00100000:1.0:1789478394.736553:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964394880 00000100:00100000:1.0:1789478394.736576:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964394880 00000100:00100000:1.0:1789478394.736665:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789478394.736674:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876403964394880:12345-0@lo:13: 00002000:00000024:1.0:1789478394.736700:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1789478394.736789:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876403964394880:12345-0@lo:13: Request processed in 116us (1528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.736796:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1789478394.736842:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03351180 x1876403964394880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478394.736865:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964394880:0@lo:13: 00000001:00080000:2.0:1789478394.745146:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:3.0:1789478394.745363:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9999:x1876403964394752:12345-0@lo:700: Request processed in 10394us (10549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478394.745377:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789478394.745502:0:9999:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f60a80 x1876403964394752/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789478410 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478394.745514:0:9999:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789478394.745531:0:9999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f60a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9999:1876403964394752:0@lo:700: 00002000:00080000:1.0:1789478394.745740:0:8829:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1789478394.745750:0:8829:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789478394.745849:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9992:x1876403964395008:12345-0@lo:7: Request processed in 10471us (10660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.745862:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789478394.745921:0:9992:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03353b80 x1876403964395008/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789478410 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478394.745947:0:9992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03353b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9992:1876403964395008:0@lo:7: 00000004:00080000:1.0:1789478394.745963:0:9992:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789478394.746008:0:9992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9992:1876403964395136:0@lo:5: 00000100:00100000:1.0:1789478394.746128:0:9992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.746174:0:9992:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03201540 going to sleep for 11 seconds 00000100:00100000:1.0:1789478394.746205:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964395136 00000100:00100000:1.0:1789478394.746213:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964395136 00000100:00100000:1.0:1789478394.746277:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789478394.746293:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9992:x1876403964395136:12345-0@lo:5: 00002000:00080000:1.0:1789478394.746327:0:8829:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1789478394.746390:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9992:x1876403964395136:12345-0@lo:5: Request processed in 102us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478394.746400:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789478394.746448:0:9992:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40ecdc00 x1876403964395136/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789478410 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478394.746458:0:9992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9992:1876403964395136:0@lo:5: 00000004:00080000:1.0:1789478394.746467:0:9992:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789478394.746493:0:9992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03351180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9992:1876403964395264:0@lo:5: 00000100:00100000:1.0:1789478394.746515:0:9992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478394.746530:0:9992:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03201540 going to sleep for 11 seconds 00000100:00100000:1.0:1789478394.746544:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964395264 00000100:00100000:1.0:1789478394.746547:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964395264 00000100:00100000:1.0:1789478394.746567:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789478394.746574:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9992:x1876403964395264:12345-0@lo:5: 00002000:00080000:1.0:1789478394.750407:0:8430:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000004:02000040:2.0:1789478394.754427:0:9999:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1789478394.758269:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9992:x1876403964395264:12345-0@lo:5: Request processed in 11685us (11742us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789478394.758285:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789478394.758560:0:9992:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03351180 x1876403964395264/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789478410 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478394.758582:0:9992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03351180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9992:1876403964395264:0@lo:5: 00000004:00080000:3.0:1789478394.758613:0:9992:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789478394.758661:0:9992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f62680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9992:1876403964395392:0@lo:900: 00000100:00100000:3.0:1789478394.758719:0:9992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478394.758751:0:9992:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478394.761038:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964395392 00000100:00100000:3.0:1789478394.761062:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964395392 00000100:00100000:3.0:1789478394.761198:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789478394.761207:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9992:x1876403964395392:12345-0@lo:900: 00000100:00100000:3.0:1789478394.761294:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9992:x1876403964395392:12345-0@lo:900: Request processed in 89us (2576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478394.761302:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789478394.761337:0:9992:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f62680 x1876403964395392/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789478410 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478394.761350:0:9992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f62680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9992:1876403964395392:0@lo:900: 00000100:00100000:2.0:1789478394.764704:0:9999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09126680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9999:1876403964395520:0@lo:5: 00000100:00100000:2.0:1789478394.764790:0:9999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478394.764862:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964395520 00000100:00100000:2.0:1789478394.764870:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964395520 00000100:00100000:2.0:1789478394.764927:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789478394.764948:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9999:x1876403964395520:12345-0@lo:5: 00000100:00100000:3.0:1789478394.769808:0:9999:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02bf6240 going to sleep for 11 seconds 00002000:00080000:2.0:1789478394.778712:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1789478394.778739:0:8431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1789478394.790365:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9999:x1876403964395520:12345-0@lo:5: Request processed in 25418us (25565us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789478394.790381:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789478394.793229:0:9999:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc09126680 x1876403964395520/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789478410 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478394.793256:0:9999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09126680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9999:1876403964395520:0@lo:5: 00000004:00080000:2.0:1789478394.793277:0:9999:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000020:00000004:0.0:1789478395.259825:0:10034:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789478395.260229:0:10034:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789478395.430337:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789478396.291051:0:10083:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789478396.291061:0:10083:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1789478396.452740:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478396.827325:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478396.827547:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945472128 00000100:00100000:2.0:1789478396.827556:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945472128 00000100:00100000:2.0:1789478396.827655:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 179 00000100:00100000:2.0:1789478396.827664:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2394:x1876403945472128:12345-192.168.206.11@tcp:250: 00010000:00080000:2.0:1789478396.827692:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 39e0b8b0-9342-4e5e-adb0-5ee35a65200e@192.168.206.11@tcp t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:2.0:1789478396.827719:0:6512:0:(genops.c:1385:class_connect()) connect: client 39e0b8b0-9342-4e5e-adb0-5ee35a65200e, cookie 0x8ebaae74e8215d79 00000100:00080000:2.0:1789478396.827891:0:6512:0:(import.c:65:import_set_state_nolock()) ffff8ebb034e0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789478396.827969:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+5:2394:x1876403945472128:12345-192.168.206.11@tcp:250: Request processed in 304us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478396.827977:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 179 00000100:00100000:3.0:1789478396.832033:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478396.832288:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945472256 00000100:00100000:2.0:1789478396.832298:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945472256 00000100:00100000:2.0:1789478396.832366:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 180 00000100:00100000:2.0:1789478396.832377:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+5:6150:x1876403945472256:12345-192.168.206.11@tcp:101: 00010000:00010000:2.0:1789478396.832407:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478396.832425:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215d80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7149 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478396.832451:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7149 expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478396.832462:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7149 expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478396.832472:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f77a00, rc 0) 00000100:00100000:2.0:1789478396.832527:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+6:6150:x1876403945472256:12345-192.168.206.11@tcp:101: Request processed in 152us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478396.832534:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 180 00000100:00100000:1.0:1789478396.835895:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478396.836036:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945472384 00000100:00100000:2.0:1789478396.836046:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945472384 00000100:00100000:2.0:1789478396.836110:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 181 00000100:00100000:2.0:1789478396.836119:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+6:6150:x1876403945472384:12345-192.168.206.11@tcp:501: 00000100:00100000:2.0:1789478396.836247:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+6:6150:x1876403945472384:12345-192.168.206.11@tcp:501: Request processed in 128us (358us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789478396.836255:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 181 00000100:00100000:0.0:1789478396.839209:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478396.839369:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945472512 00000100:00100000:3.0:1789478396.839378:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945472512 00000100:00100000:3.0:1789478396.839433:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 182 00000100:00100000:3.0:1789478396.839442:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+6:6150:x1876403945472512:12345-192.168.206.11@tcp:101: 00010000:00010000:3.0:1789478396.839457:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478396.839473:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc00031000/0x8ebaae74e8215d87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7150 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478396.839501:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc00031000/0x8ebaae74e8215d87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7150 expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478396.839513:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc00031000/0x8ebaae74e8215d87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7150 expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478396.839522:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc00031000, rc 0) 00000100:00100000:3.0:1789478396.839582:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+7:6150:x1876403945472512:12345-192.168.206.11@tcp:101: Request processed in 141us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478396.839642:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 182 00000100:00100000:3.0:1789478396.841485:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478396.841553:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945472640 00000100:00100000:1.0:1789478396.841562:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945472640 00000100:00100000:1.0:1789478396.841631:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 183 00000100:00100000:1.0:1789478396.841643:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+7:6150:x1876403945472640:12345-192.168.206.11@tcp:501: 00000100:00100000:1.0:1789478396.841802:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+8:6150:x1876403945472640:12345-192.168.206.11@tcp:501: Request processed in 161us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478396.841811:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 183 00000100:00100000:1.0:1789478396.844033:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478396.844372:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945472768 00000100:00100000:2.0:1789478396.844380:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945472768 00000100:00100000:2.0:1789478396.844443:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 184 00000100:00100000:2.0:1789478396.844452:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+8:6150:x1876403945472768:12345-192.168.206.11@tcp:503: 00000100:00100000:2.0:1789478396.844786:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+8:6150:x1876403945472768:12345-192.168.206.11@tcp:503: Request processed in 334us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478396.844804:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 184 00000100:00100000:2.0:1789478396.848863:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478396.849015:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945472896 00000100:00100000:1.0:1789478396.849025:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945472896 00000100:00100000:1.0:1789478396.849076:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 185 00000100:00100000:1.0:1789478396.849086:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+8:6168:x1876403945472896:12345-192.168.206.11@tcp:502: 00000100:00100000:1.0:1789478396.849239:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+8:6168:x1876403945472896:12345-192.168.206.11@tcp:502: Request processed in 154us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478396.849248:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 185 00000100:00100000:0.0:1789478396.887196:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478396.887355:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945473024 00000100:00100000:3.0:1789478396.887364:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945473024 00000100:00100000:3.0:1789478396.887423:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 186 00000100:00100000:3.0:1789478396.887441:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+8:6168:x1876403945473024:12345-192.168.206.11@tcp:502: 00000100:00100000:3.0:1789478396.887623:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+8:6168:x1876403945473024:12345-192.168.206.11@tcp:502: Request processed in 160us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478396.887633:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 186 00000100:00100000:3.0:1789478396.891444:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478396.891540:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945473152 00000100:00100000:2.0:1789478396.891550:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945473152 00000100:00100000:2.0:1789478396.891635:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 187 00000100:00100000:2.0:1789478396.891645:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+8:6150:x1876403945473152:12345-192.168.206.11@tcp:101: 00010000:00010000:2.0:1789478396.891674:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478396.891690:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc34f77400/0x8ebaae74e8215d8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7181 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478396.891715:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc34f77400/0x8ebaae74e8215d8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7181 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478396.891725:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc34f77400/0x8ebaae74e8215d8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7181 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478396.891733:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f77400, rc 0) 00000100:00100000:2.0:1789478396.891919:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+9:6150:x1876403945473152:12345-192.168.206.11@tcp:101: Request processed in 275us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478396.891938:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 187 00000100:00100000:2.0:1789478396.897413:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478396.897501:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945473280 00000100:00100000:1.0:1789478396.897510:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945473280 00000100:00100000:1.0:1789478396.897563:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 188 00000100:00100000:1.0:1789478396.897573:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+9:6150:x1876403945473280:12345-192.168.206.11@tcp:256: 20000000:01000000:1.0:1789478396.897629:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789478396.897661:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789478396.897665:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789478396.897668:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789478396.897671:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789478396.897674:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1789478396.903277:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+9:6150:x1876403945473280:12345-192.168.206.11@tcp:256: Request processed in 5696us (5864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478396.903291:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 188 00000100:00100000:3.0:1789478396.906534:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478396.906892:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945473408 00000100:00100000:1.0:1789478396.906901:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945473408 00000100:00100000:1.0:1789478396.906962:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 189 00000100:00100000:1.0:1789478396.906971:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+9:6150:x1876403945473408:12345-192.168.206.11@tcp:101: 00010000:00010000:1.0:1789478396.906986:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478396.907003:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40fce400/0x8ebaae74e8215d95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7188 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478396.907041:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40fce400/0x8ebaae74e8215d95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7188 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478396.907053:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40fce400/0x8ebaae74e8215d95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7188 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478396.907062:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fce400, rc 0) 00000100:00100000:1.0:1789478396.908873:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:6150:x1876403945473408:12345-192.168.206.11@tcp:101: Request processed in 1894us (2337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478396.908885:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 189 00000100:00100000:2.0:1789478396.910747:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478396.911969:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945473536 00000100:00100000:1.0:1789478396.911980:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945473536 00000100:00100000:1.0:1789478396.912036:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 190 00000100:00100000:1.0:1789478396.912045:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc272ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:6150:x1876403945473536:12345-192.168.206.11@tcp:501: 00000100:00100000:1.0:1789478396.912183:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc272ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:6150:x1876403945473536:12345-192.168.206.11@tcp:501: Request processed in 137us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478396.912190:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 190 00000100:00100000:0.0:1789478396.914232:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478396.915356:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945473664 00000100:00100000:1.0:1789478396.915367:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945473664 00000100:00100000:1.0:1789478396.915428:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 191 00000100:00100000:1.0:1789478396.915438:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc272aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:6150:x1876403945473664:12345-192.168.206.11@tcp:503: 00000100:00100000:1.0:1789478396.915579:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc272aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:6150:x1876403945473664:12345-192.168.206.11@tcp:503: Request processed in 142us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478396.915587:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 191 00000100:00100000:3.0:1789478396.919914:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478396.919980:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945473792 00000100:00100000:2.0:1789478396.919989:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945473792 00000100:00100000:2.0:1789478396.920154:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 192 00000100:00100000:2.0:1789478396.920165:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:6172:x1876403945473792:12345-192.168.206.11@tcp:502: 00000100:00100000:2.0:1789478396.920305:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:6172:x1876403945473792:12345-192.168.206.11@tcp:502: Request processed in 142us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478396.920318:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 192 00000100:00100000:2.0:1789478396.923743:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478396.924622:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945473920 00000100:00100000:1.0:1789478396.924649:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945473920 00000100:00100000:1.0:1789478396.924710:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 193 00000100:00100000:1.0:1789478396.924720:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:6172:x1876403945473920:12345-192.168.206.11@tcp:502: 00000100:00100000:1.0:1789478396.925455:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:6172:x1876403945473920:12345-192.168.206.11@tcp:502: Request processed in 734us (1717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478396.925465:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 193 00000100:00100000:0.0:1789478396.932226:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478396.932268:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478396.932359:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945474048 00000100:00100000:2.0:1789478396.932369:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945474048 00000100:00100000:2.0:1789478396.932423:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945474304 00000100:00100000:2.0:1789478396.932436:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945474304 00000100:00100000:2.0:1789478396.932453:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:2.0:1789478396.932461:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1876403945474048:12345-192.168.206.11@tcp:38: 00010000:00080000:2.0:1789478396.932748:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:2.0:1789478396.933970:0:6518:0:(genops.c:1385:class_connect()) connect: client 327dd6d5-45fd-4b52-99bf-74d27d1ede6e, cookie 0x8ebaae74e8215d9c 00000004:00100000:2.0:1789478396.933998:0:6518:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789478396.934214:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8ebb034e2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789478396.934291:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2394:x1876403945474048:12345-192.168.206.11@tcp:38: Request processed in 1828us (2070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478396.934300:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:2.0:1789478396.934325:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 8 00000100:00100000:2.0:1789478396.934331:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1876403945474304:12345-192.168.206.11@tcp:38: 00010000:00080000:2.0:1789478396.934351:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:2.0:1789478396.934399:0:6518:0:(genops.c:1385:class_connect()) connect: client 327dd6d5-45fd-4b52-99bf-74d27d1ede6e, cookie 0x8ebaae74e8215da3 00000004:00100000:2.0:1789478396.934411:0:6518:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789478396.934615:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8ebb034e2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789478396.934645:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2394:x1876403945474304:12345-192.168.206.11@tcp:38: Request processed in 312us (2375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478396.934652:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 8 00010000:00010000:1.0:1789478397.477041:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478397.670216:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964395648:0@lo:13: 00000100:00100000:1.0:1789478397.670285:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478397.670431:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964395648 00000100:00100000:3.0:1789478397.670439:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964395648 00000100:00100000:3.0:1789478397.670508:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789478397.670518:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964395648:12345-0@lo:13: 00002000:00000024:3.0:1789478397.670547:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478397.670631:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964395648:12345-0@lo:13: Request processed in 115us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478397.670638:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789478397.670674:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c962300 x1876403964395648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478397.670691:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964395648:0@lo:13: 00000100:00080000:0.0:1789478397.671075:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789478397.938337:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478397.938381:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478397.938888:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478397.943304:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945474432 00000100:00100000:0.0:1789478397.943318:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945474432 00000100:00100000:0.0:1789478397.943895:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945474176 00000100:00100000:0.0:1789478397.943901:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945474176 00000100:00100000:0.0:1789478397.943934:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945474560 00000100:00100000:0.0:1789478397.943937:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945474560 00000100:00100000:0.0:1789478397.943957:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:0.0:1789478397.943967:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:0:x1876403945474432:12345-192.168.206.11@tcp:41: 00000004:00000024:0.0:1789478397.944001:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789478397.944066:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:0:x1876403945474432:12345-192.168.206.11@tcp:41: Request processed in 100us (5738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478397.944073:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:0.0:1789478397.944090:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:0.0:1789478397.944097:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:0:x1876403945474176:12345-192.168.206.11@tcp:41: 00000004:00000024:0.0:1789478397.944127:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789478397.944155:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:0:x1876403945474176:12345-192.168.206.11@tcp:41: Request processed in 59us (5774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478397.944161:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:0.0:1789478397.944174:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 11 00000100:00100000:0.0:1789478397.944180:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:6150:x1876403945474560:12345-192.168.206.11@tcp:41: 00000004:00000024:0.0:1789478397.944190:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789478397.944207:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:6150:x1876403945474560:12345-192.168.206.11@tcp:41: Request processed in 28us (5322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478397.944212:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 11 00000100:00080000:3.0:1789478397.944427:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789478397.944431:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789478397.946128:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478397.946159:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945474688 00000100:00100000:0.0:1789478397.946168:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945474688 00000100:00100000:0.0:1789478397.946204:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:0.0:1789478397.946212:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:6150:x1876403945474688:12345-192.168.206.11@tcp:40: 00000100:00100000:0.0:1789478397.946272:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:6150:x1876403945474688:12345-192.168.206.11@tcp:40: Request processed in 60us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478397.946280:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:0.0:1789478397.951291:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478397.951369:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478397.955247:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478397.955282:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478397.955416:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945475072 00000100:00100000:2.0:1789478397.955444:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945475072 00000100:00100000:2.0:1789478397.955500:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:2.0:1789478397.955509:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:6150:x1876403945475072:12345-192.168.206.11@tcp:900: 00000100:00100000:2.0:1789478397.955588:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:6150:x1876403945475072:12345-192.168.206.11@tcp:900: Request processed in 80us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478397.955617:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:2.0:1789478397.955718:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945475200 00000100:00100000:2.0:1789478397.955735:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945475200 00000100:00100000:2.0:1789478397.955765:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 194 00000100:00100000:2.0:1789478397.955773:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:2396:x1876403945475200:12345-192.168.206.11@tcp:400: 00000100:00100000:2.0:1789478397.955806:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:2396:x1876403945475200:12345-192.168.206.11@tcp:400: Request processed in 34us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478397.955812:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 194 00000100:00100000:3.0:1789478397.956991:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945474816 00000100:00100000:3.0:1789478397.957002:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945474816 00000100:00100000:3.0:1789478397.957043:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945474944 00000100:00100000:3.0:1789478397.957047:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945474944 00000100:00100000:3.0:1789478397.957067:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:3.0:1789478397.957074:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1876403945474816:12345-192.168.206.11@tcp:8: 00010000:00080000:3.0:1789478397.957102:0:8829:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:3.0:1789478397.957129:0:8829:0:(genops.c:1385:class_connect()) connect: client 327dd6d5-45fd-4b52-99bf-74d27d1ede6e, cookie 0x8ebaae74e8215daa 00002000:00100000:3.0:1789478397.957139:0:8829:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 327dd6d5-45fd-4b52-99bf-74d27d1ede6e/ffff8ebc40fb9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789478397.957149:0:8829:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789478397.957306:0:8829:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789478397.957331:0:8829:0:(import.c:65:import_set_state_nolock()) ffff8ebc40fbd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789478397.957377:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2394:x1876403945474816:12345-192.168.206.11@tcp:8: Request processed in 302us (6093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478397.957385:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:3.0:1789478397.957399:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:3.0:1789478397.957404:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1876403945474944:12345-192.168.206.11@tcp:8: 00010000:00080000:3.0:1789478397.957420:0:8829:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:3.0:1789478397.958169:0:8829:0:(genops.c:1385:class_connect()) connect: client 327dd6d5-45fd-4b52-99bf-74d27d1ede6e, cookie 0x8ebaae74e8215db1 00002000:00100000:3.0:1789478397.958178:0:8829:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 327dd6d5-45fd-4b52-99bf-74d27d1ede6e/ffff8ebc40fbb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789478397.958191:0:8829:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789478397.958337:0:8829:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789478397.958364:0:8829:0:(import.c:65:import_set_state_nolock()) ffff8ebc40fbb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789478397.958419:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2394:x1876403945474944:12345-192.168.206.11@tcp:8: Request processed in 1012us (7048us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478397.959615:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:2.0:1789478397.961021:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478397.961135:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945475328 00000100:00100000:3.0:1789478397.961143:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945475328 00000100:00100000:3.0:1789478397.961196:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:3.0:1789478397.961207:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:6150:x1876403945475328:12345-192.168.206.11@tcp:33: 00000004:00080000:3.0:1789478397.978669:0:6520:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 17381us 00000004:00200000:0.0:1789478397.989178:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789478397.989287:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:6150:x1876403945475328:12345-192.168.206.11@tcp:33: Request processed in 28077us (28267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478397.989303:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:2.0:1789478398.181835:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964395776:0@lo:13: 00000100:00100000:2.0:1789478398.181910:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478398.182339:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964395776 00000100:00100000:1.0:1789478398.182347:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964395776 00000100:00100000:1.0:1789478398.182432:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789478398.182442:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964395776:12345-0@lo:13: 00002000:00000024:1.0:1789478398.182462:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789478398.182519:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964395776:12345-0@lo:13: Request processed in 79us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478398.182527:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1789478398.182613:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789478398.182681:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c894700 x1876403964395776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478398.182700:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964395776:0@lo:13: 00000100:00100000:2.0:1789478398.185703:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478398.185846:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945475456 00000100:00100000:0.0:1789478398.185855:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945475456 00000100:00100000:0.0:1789478398.185905:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 13 00000100:00100000:0.0:1789478398.185912:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:6191:x1876403945475456:12345-192.168.206.11@tcp:101: 00010000:00010000:0.0:1789478398.185941:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478398.186012:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66200/0x8ebaae74e8215db8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b71b9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478398.186070:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e8215dbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478398.186082:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e8215dbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478398.186095:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e8215dbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789478398.186196:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789478398.186200:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789478398.186216:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e8215dbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478398.186243:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66200/0x8ebaae74e8215db8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b71b9 expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478398.186261:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e8215dbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b71b9 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478398.186288:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc40e36400) 00010000:00010000:0.0:1789478398.186291:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789478398.186295:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b67e00, rc 0) 00000100:00100000:0.0:1789478398.186349:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:6191:x1876403945475456:12345-192.168.206.11@tcp:101: Request processed in 437us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478398.186357:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 13 00010000:00010000:0.0:1789478398.500864:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478399.524901:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478399.716963:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964395904:0@lo:41: 00000100:00100000:2.0:1789478399.717007:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964396032:0@lo:41: 00000100:00100000:0.0:1789478399.717035:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478399.717074:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478399.717150:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964395904 00000100:00100000:2.0:1789478399.717158:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964395904 00000100:00100000:2.0:1789478399.717214:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964396032 00000100:00100000:2.0:1789478399.717217:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964396032 00000100:00100000:2.0:1789478399.717239:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789478399.717248:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964395904:12345-0@lo:41: 00000100:00100000:1.0:1789478399.717277:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000004:00000024:2.0:1789478399.717288:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789478399.717289:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964396032:12345-0@lo:41: 00000004:00000024:1.0:1789478399.717310:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789478399.717355:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964396032:12345-0@lo:41: Request processed in 70us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478399.717362:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789478399.717692:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964395904:12345-0@lo:41: Request processed in 444us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478399.717700:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789478399.717723:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964396160:0@lo:400: 00000100:00100000:2.0:1789478399.717755:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478399.717789:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964396160 00000100:00100000:1.0:1789478399.717795:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964396160 00000100:00100000:2.0:1789478399.717816:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964396032:0@lo:41: 00000100:00100000:1.0:1789478399.717829:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789478399.717837:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3646:x1876403964396160:12345-0@lo:400: 00000100:00100000:2.0:1789478399.717873:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964396288:0@lo:400: 00000100:00100000:1.0:1789478399.717886:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3646:x1876403964396160:12345-0@lo:400: Request processed in 49us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478399.717895:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789478399.717906:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478399.717954:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964396288 00000100:00100000:2.0:1789478399.717959:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964396288 00000100:00100000:1.0:1789478399.717961:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964396160:0@lo:400: 00000100:00100000:2.0:1789478399.717997:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789478399.718006:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964396288:12345-0@lo:400: 00000100:00100000:2.0:1789478399.718041:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964396288:12345-0@lo:400: Request processed in 36us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478399.722521:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964396544:0@lo:400: 00000100:00100000:3.0:1789478399.722590:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478399.722647:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964397056:0@lo:400: 00000100:00100000:3.0:1789478399.722670:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478399.722688:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789478399.722694:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964396672:0@lo:400: 00000100:00100000:3.0:1789478399.722715:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478399.722725:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876403964397184:0@lo:400: 00000100:00100000:3.0:1789478399.722767:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478399.723116:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789478399.723137:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964396544 00000100:00100000:2.0:1789478399.723143:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964397056 00000100:00100000:1.0:1789478399.723146:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964396544 00000100:00100000:2.0:1789478399.723149:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964397056 00000100:00100000:2.0:1789478399.723191:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964396672 00000100:00100000:2.0:1789478399.723195:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964396672 00000100:00100000:1.0:1789478399.723196:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964397184 00000100:00100000:1.0:1789478399.723201:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964397184 00000100:00100000:2.0:1789478399.723219:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789478399.723230:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964397056:12345-0@lo:400: 00000100:00100000:1.0:1789478399.723235:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789478399.723243:0:6517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789478399.723409:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964397056:12345-0@lo:400: Request processed in 181us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478399.723416:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1789478399.723445:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789478399.723449:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789478399.723481:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964397056:0@lo:400: 00000100:00100000:2.0:1789478399.723495:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789478399.723505:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964396544:12345-0@lo:400: 00000100:00100000:3.0:1789478399.723524:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964396800:0@lo:400: 00000100:00100000:1.0:1789478399.723545:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789478399.723550:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964396544:12345-0@lo:400: Request processed in 46us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478399.723556:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964396672:12345-0@lo:400: 00000100:00100000:3.0:1789478399.723559:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478399.723570:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789478399.723586:0:6518:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789478399.723590:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964397312:0@lo:400: 00000100:00100000:2.0:1789478399.723611:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789478399.723619:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876403964397184:12345-0@lo:400: 00000100:00100000:2.0:1789478399.723658:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876403964397184:12345-0@lo:400: Request processed in 40us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478399.723664:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478399.723669:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789478399.723702:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964396288:0@lo:400: 00000100:00100000:3.0:1789478399.723721:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789478399.723729:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964396416:0@lo:400: 00010000:00080000:2.0:1789478399.723730:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb01b71f80 x1876403964397184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478399.723744:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876403964397184:0@lo:400: 00000100:00100000:3.0:1789478399.723759:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478399.723761:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964396544:0@lo:400: 00000100:00100000:3.0:1789478399.723785:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964396928:0@lo:400: 00000100:00100000:2.0:1789478399.723789:0:6518:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789478399.723796:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964396416 00000100:00100000:2.0:1789478399.723799:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964396416 00000100:00100000:3.0:1789478399.723812:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478399.723820:0:6518:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789478399.723829:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789478399.723837:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964396416:12345-0@lo:400: 00000100:00100000:2.0:1789478399.723866:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964396416:12345-0@lo:400: Request processed in 32us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478399.723871:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789478399.723896:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964396800 00000100:00100000:2.0:1789478399.723899:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964396800 00000100:00100000:2.0:1789478399.723936:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964397312 00000100:00100000:2.0:1789478399.723941:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964397312 00000100:00100000:2.0:1789478399.723963:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964396928 00000100:00100000:2.0:1789478399.723966:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964396928 00000100:00100000:2.0:1789478399.723982:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789478399.723990:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964396672:12345-0@lo:400: Request processed in 436us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478399.723998:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964396800:12345-0@lo:400: 00000100:00100000:1.0:1789478399.724002:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789478399.724035:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964396800:12345-0@lo:400: Request processed in 40us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478399.724042:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789478399.724053:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789478399.724059:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1876403964397312:12345-0@lo:400: 00000100:00100000:2.0:1789478399.724081:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1876403964397312:12345-0@lo:400: Request processed in 24us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478399.724086:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789478399.724095:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789478399.724101:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964396928:12345-0@lo:400: 00000100:00100000:2.0:1789478399.724124:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964396928:12345-0@lo:400: Request processed in 24us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478399.724129:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789478399.724154:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f63480 x1876403964396672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478399.724163:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964396672:0@lo:400: 00000100:00080000:2.0:1789478399.724194:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789478399.724197:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789478399.725107:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964397440:0@lo:400: 00000100:00100000:0.0:1789478399.725159:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964395904:0@lo:41: 00000100:00100000:3.0:1789478399.725329:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789478399.725361:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f61c00 x1876403964396800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478399.725372:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964396800:0@lo:400: 00010000:00080000:3.0:1789478399.725381:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc34cb6300 x1876403964397312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478399.725388:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964397312:0@lo:400: 00000100:00100000:3.0:1789478399.725409:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964396416:0@lo:400: 00010000:00080000:3.0:1789478399.725418:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f60a80 x1876403964396928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478399.725427:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964396928:0@lo:400: 00000100:00100000:2.0:1789478399.725819:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964397440 00000100:00100000:2.0:1789478399.725825:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964397440 00000100:00100000:2.0:1789478399.725948:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789478399.725958:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1876403964397440:12345-0@lo:400: 00000100:00080000:3.0:1789478399.726088:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789478399.726129:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1876403964397440:12345-0@lo:400: Request processed in 172us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478399.726136:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789478399.726378:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc34cb7100 x1876403964397440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478399.726390:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964397440:0@lo:400: 00000100:00100000:0.0:1789478399.923351:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478399.923492:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945475584 00000100:00100000:3.0:1789478399.923502:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945475584 00000100:00100000:3.0:1789478399.923575:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00100000:3.0:1789478399.923585:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:6243:x1876403945475584:12345-192.168.206.11@tcp:41: 00000004:00000024:3.0:1789478399.923646:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789478399.923700:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:6243:x1876403945475584:12345-192.168.206.11@tcp:41: Request processed in 117us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478399.923707:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00080000:0.0:1789478399.923846:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789478399.926736:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478399.926826:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945475712 00000100:00100000:0.0:1789478399.926836:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945475712 00000100:00100000:0.0:1789478399.926951:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00100000:0.0:1789478399.926962:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:6243:x1876403945475712:12345-192.168.206.11@tcp:41: 00000004:00000024:0.0:1789478399.926996:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789478399.927061:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:6243:x1876403945475712:12345-192.168.206.11@tcp:41: Request processed in 102us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478399.927069:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00080000:3.0:1789478399.928162:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789478399.930342:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478399.930449:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945475840 00000100:00100000:1.0:1789478399.930457:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945475840 00000100:00100000:1.0:1789478399.930536:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00100000:1.0:1789478399.930546:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:6243:x1876403945475840:12345-192.168.206.11@tcp:13: 00002000:00000024:1.0:1789478399.930585:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789478399.930672:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:6243:x1876403945475840:12345-192.168.206.11@tcp:13: Request processed in 127us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478399.930680:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00080000:3.0:1789478399.930801:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789478399.933100:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478399.933199:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945475968 00000100:00100000:1.0:1789478399.933208:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945475968 00000100:00100000:1.0:1789478399.933317:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00100000:1.0:1789478399.933328:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:6243:x1876403945475968:12345-192.168.206.11@tcp:13: 00002000:00000024:1.0:1789478399.933370:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789478399.933436:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:6243:x1876403945475968:12345-192.168.206.11@tcp:13: Request processed in 109us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478399.933443:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00080000:3.0:1789478399.942140:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789478400.230961:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c94ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964397568:0@lo:13: 00000100:00100000:2.0:1789478400.231033:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478400.231108:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964397568 00000100:00100000:3.0:1789478400.231116:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964397568 00000100:00100000:3.0:1789478400.231169:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789478400.231179:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876403964397568:12345-0@lo:13: 00002000:00000024:3.0:1789478400.231199:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478400.231242:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876403964397568:12345-0@lo:13: Request processed in 65us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478400.231249:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789478400.231338:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c94ea00 x1876403964397568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478400.231356:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c94ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964397568:0@lo:13: 00000100:00100000:2.0:1789478400.231536:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789478400.231819:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964397696:0@lo:13: 00000100:00100000:2.0:1789478400.231849:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478400.232117:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964397696 00000100:00100000:3.0:1789478400.232122:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964397696 00000100:00100000:3.0:1789478400.232191:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789478400.232200:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876403964397696:12345-0@lo:13: 00002000:00000024:3.0:1789478400.232212:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478400.232259:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876403964397696:12345-0@lo:13: Request processed in 61us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478400.232280:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1789478400.232344:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c897800 x1876403964397696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478400.232359:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964397696:0@lo:13: 00010000:00010000:1.0:1789478400.554887:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789478400.746637:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 327dd6d5-45fd-4b52-99bf-74d27d1ede6e 00000001:00080000:3.0:1789478400.746651:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:3.0:1789478400.746661:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1789478401.575460:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789478402.073589:0:10181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789478402.597265:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789478402.790666:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 327dd6d5-45fd-4b52-99bf-74d27d1ede6e 00000100:00100000:3.0:1789478402.791048:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964397824:0@lo:13: 00000100:00100000:3.0:1789478402.791109:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478402.791419:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964397824 00000100:00100000:2.0:1789478402.791427:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964397824 00000100:00100000:2.0:1789478402.791487:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789478402.791507:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964397824:12345-0@lo:13: 00002000:00000024:2.0:1789478402.791539:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1789478402.791716:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1789478402.792156:0:6496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 327dd6d5-45fd-4b52-99bf-74d27d1ede6e 00000100:00100000:2.0:1789478402.792320:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964397824:12345-0@lo:13: Request processed in 824us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478402.792330:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1789478402.792483:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3cbc5f80 x1876403964397824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478402.792695:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964397824:0@lo:13: 00000100:00100000:0.0:1789478403.197956:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478403.197996:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478403.198024:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478403.198048:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478403.198072:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478403.198098:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945476608 00000100:00100000:0.0:1789478403.198105:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945476608 00000100:00100000:0.0:1789478403.198148:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945476480 00000100:00100000:0.0:1789478403.198150:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945476480 00000100:00100000:0.0:1789478403.198171:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00100000:0.0:1789478403.198181:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2398:x1876403945476608:12345-192.168.206.11@tcp:400: 00000100:00100000:0.0:1789478403.198237:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2398:x1876403945476608:12345-192.168.206.11@tcp:400: Request processed in 58us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478403.198243:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00100000:0.0:1789478403.198258:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00100000:0.0:1789478403.198265:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2398:x1876403945476480:12345-192.168.206.11@tcp:400: 00000100:00100000:0.0:1789478403.198287:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2398:x1876403945476480:12345-192.168.206.11@tcp:400: Request processed in 22us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478403.198293:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00100000:0.0:1789478403.198316:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945476352 00000100:00100000:0.0:1789478403.198320:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945476352 00000100:00100000:0.0:1789478403.198343:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945476224 00000100:00100000:0.0:1789478403.198346:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945476224 00000100:00100000:0.0:1789478403.198366:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 48 00000100:00100000:0.0:1789478403.198373:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2398:x1876403945476352:12345-192.168.206.11@tcp:400: 00000100:00100000:0.0:1789478403.198415:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2398:x1876403945476352:12345-192.168.206.11@tcp:400: Request processed in 42us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478403.198433:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 48 00000100:00100000:0.0:1789478403.198446:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 49 00000100:00100000:0.0:1789478403.198452:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2398:x1876403945476224:12345-192.168.206.11@tcp:400: 00000100:00100000:0.0:1789478403.198477:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2398:x1876403945476224:12345-192.168.206.11@tcp:400: Request processed in 26us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478403.198483:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 49 00000100:00080000:0.0:1789478403.198502:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789478403.198505:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789478403.198508:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789478403.198509:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789478403.198691:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945476096 00000100:00100000:1.0:1789478403.198696:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945476096 00000100:00100000:1.0:1789478403.198734:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 196 00000100:00100000:1.0:1789478403.198741:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:2398:x1876403945476096:12345-192.168.206.11@tcp:400: 00000100:00100000:1.0:1789478403.198772:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:2398:x1876403945476096:12345-192.168.206.11@tcp:400: Request processed in 31us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478403.198777:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 196 00000100:00100000:1.0:1789478403.301776:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789478403.301807:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964397952:0@lo:13: 00000100:00100000:1.0:1789478403.301865:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478403.302297:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964397952 00000100:00100000:1.0:1789478403.302305:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964397952 00000100:00100000:1.0:1789478403.302352:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789478403.302362:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964397952:12345-0@lo:13: 00002000:00000024:1.0:1789478403.302382:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789478403.302435:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964397952:12345-0@lo:13: Request processed in 74us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478403.302441:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789478403.302484:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c897100 x1876403964397952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789478403.302709:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789478403.302763:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964397952:0@lo:13: 00010000:00010000:1.0:1789478403.620753:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789478403.814227:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 327dd6d5-45fd-4b52-99bf-74d27d1ede6e 00010000:00010000:0.0:1789478404.651748:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789478404.769902:0:10329:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd19ddd670 20000000:00000080:0.0:1789478404.769918:0:10329:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ebb03617800 uarg=0000000000000000 20000000:01000000:0.0:1789478404.769965:0:10329:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1789478404.769968:0:10329:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1789478404.769971:0:10329:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789478404.769976:0:10329:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789478404.769980:0:10329:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1789478404.770034:0:10329:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789478404.770037:0:10329:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789478404.770411:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1789478404.770867:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1789478404.770989:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1789478404.771006:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1789478404.771014:0:10329:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789478404.771016:0:10329:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789478404.771420:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1789478404.771698:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1789478404.771723:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1789478404.771737:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:0.0:1789478404.771754:0:10329:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789478404.771756:0:10329:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789478404.772171:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1789478404.772321:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1789478404.772341:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1789478404.772357:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1789478404.772365:0:10329:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789478404.772367:0:10329:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789478404.773830:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1789478404.774123:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1789478404.774151:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1789478404.774165:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1789478404.774185:0:10329:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789478404.774188:0:10329:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789478404.774575:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1789478404.774988:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1789478404.775012:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1789478404.775028:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:2.0:1789478404.775040:0:10329:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789478404.775059:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ebc34f77000/0x8ebaae74e8215dc6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.775075:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc34f76400/0x8ebaae74e8215c61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215c5a expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.775082:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc34f77800/0x8ebaae74e8215c8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215c84 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.775088:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc42177000/0x8ebaae74e8215cca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215cc3 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.775093:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215cd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215cd1 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.775099:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc42176c00/0x8ebaae74e8215ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215cdf expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.775105:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc40fcf200/0x8ebaae74e8215d02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215cfb expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.775111:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc35b67200/0x8ebaae74e8215d2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215d25 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.775117:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc35b67a00/0x8ebaae74e8215d48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215d41 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.775136:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc34f76200/0x8ebaae74e8215d72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215d6b expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.775145:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7149 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.775153:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc00031000/0x8ebaae74e8215d87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7150 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.775159:0:10329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ebc34f77000/0x8ebaae74e8215dc6 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.775194:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc00031000/0x8ebaae74e8215d87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7150 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.775210:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ebc00031000/0x8ebaae74e8215d87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7150 expref: 9 pid: 6511 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478404.775225:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876403964398080:192.168.206.11@tcp:104: 00010000:00010000:2.0:1789478404.778376:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7149 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.778394:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215d80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7149 expref: 9 pid: 6510 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478404.778409:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08886300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876403964398208:192.168.206.11@tcp:104: 00010000:00010000:2.0:1789478404.778492:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc34f76200/0x8ebaae74e8215d72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215d6b expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.778512:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc34f76200/0x8ebaae74e8215d72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215d6b expref: 23 pid: 6512 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478404.778523:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876403964398336:0@lo:104: 00000100:00100000:2.0:1789478404.778562:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789478404.778703:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc35b67a00/0x8ebaae74e8215d48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215d41 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.778712:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc35b67a00/0x8ebaae74e8215d48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215d41 expref: 23 pid: 6512 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478404.778721:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876403964398464:0@lo:104: 00000100:00100000:2.0:1789478404.778743:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478404.785978:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964398336 00000100:00100000:3.0:1789478404.785992:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964398336 00000100:00100000:0.0:1789478404.786066:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964398464 00000100:00100000:0.0:1789478404.786070:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964398464 00000100:00100000:0.0:1789478404.786098:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789478404.786106:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03599500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+4:10329:x1876403964398336:12345-0@lo:104: 00010000:00010000:0.0:1789478404.786122:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcfe00/0x8ebaae74e8215d6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215d72 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.786205:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789478404.786210:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03599500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+4:10329:x1876403964398336:12345-0@lo:104: Request processed in 105us (7648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478404.786217:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789478404.786233:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789478404.786239:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03599880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+3:10329:x1876403964398464:12345-0@lo:104: 00010000:00010000:0.0:1789478404.786247:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc421edc00/0x8ebaae74e8215d41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215d48 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.786281:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789478404.786286:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03599880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+3:10329:x1876403964398464:12345-0@lo:104: Request processed in 47us (7543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478404.786292:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1789478404.786353:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc35b67200/0x8ebaae74e8215d2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215d25 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.786365:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc35b67200/0x8ebaae74e8215d2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215d25 expref: 23 pid: 6511 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478404.786378:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876403964398592:0@lo:104: 00000100:00100000:0.0:1789478404.786408:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478404.786428:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964398592 00000100:00100000:0.0:1789478404.786431:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964398592 00000100:00100000:0.0:1789478404.786448:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789478404.786454:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+3:10329:x1876403964398592:12345-0@lo:104: 00010000:00010000:0.0:1789478404.786461:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf000/0x8ebaae74e8215d25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215d2c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.786492:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789478404.786497:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+3:10329:x1876403964398592:12345-0@lo:104: Request processed in 44us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478404.786503:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1789478404.786517:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789478404.786523:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcfe00/0x8ebaae74e8215d6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215d72 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.786531:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfe00 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478404.786535:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcfe00/0x8ebaae74e8215d6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215d72 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.786544:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcfe00/0x8ebaae74e8215d6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215d72 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478404.786562:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcfe00/0x8ebaae74e8215d6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215d72 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478404.786569:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789478404.786623:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcfe00/0x8ebaae74e8215d6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215d72 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.786630:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478404.786647:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcfe00/0x8ebaae74e8215d6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215d72 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.786655:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcfe00/0x8ebaae74e8215d6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215d72 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.786668:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789478404.786671:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc421edc00/0x8ebaae74e8215d41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215d48 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.786677:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc421edc00 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478404.786680:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc421edc00/0x8ebaae74e8215d41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215d48 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.786687:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc421edc00/0x8ebaae74e8215d41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215d48 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478404.786694:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc421edc00/0x8ebaae74e8215d41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215d48 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478404.786699:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789478404.786719:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc421edc00/0x8ebaae74e8215d41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215d48 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.786725:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478404.786730:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc421edc00/0x8ebaae74e8215d41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215d48 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.786736:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc421edc00/0x8ebaae74e8215d41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215d48 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.786746:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789478404.786749:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf000/0x8ebaae74e8215d25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215d2c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.786755:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcf000 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478404.786758:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf000/0x8ebaae74e8215d25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215d2c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.786764:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf000/0x8ebaae74e8215d25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215d2c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478404.786771:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf000/0x8ebaae74e8215d25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215d2c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478404.786776:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789478404.786787:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf000/0x8ebaae74e8215d25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215d2c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.786792:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478404.786805:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf000/0x8ebaae74e8215d25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215d2c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.786822:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf000/0x8ebaae74e8215d25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215d2c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.786831:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478404.786833:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478404.786835:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478404.786855:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964398720:0@lo:103: 00010000:00010000:2.0:1789478404.787039:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478404.787124:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478404.787198:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789478404.787205:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964398848:0@lo:103: 00000100:00100000:0.0:1789478404.787228:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789478404.787552:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478404.787563:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964398976:0@lo:103: 00010000:00010000:3.0:1789478404.787840:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc40fcf200/0x8ebaae74e8215d02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215cfb expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478404.787853:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc40fcf200/0x8ebaae74e8215d02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215cfb expref: 23 pid: 6511 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478404.787864:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c94df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876403964399104:0@lo:104: 00000100:00100000:3.0:1789478404.787907:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789478404.788020:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc42176c00/0x8ebaae74e8215ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215cdf expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478404.788030:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc42176c00/0x8ebaae74e8215ce6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215cdf expref: 23 pid: 6511 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478404.788039:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c94dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876403964399232:0@lo:104: 00010000:00010000:3.0:1789478404.788064:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215cd1 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478404.788082:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215cd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215cd1 expref: 23 pid: 6512 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478404.788091:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c94f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876403964399360:0@lo:104: 00010000:00010000:3.0:1789478404.788116:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc42177000/0x8ebaae74e8215cca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215cc3 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478404.788124:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc42177000/0x8ebaae74e8215cca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215cc3 expref: 23 pid: 6510 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478404.788133:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c94f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876403964399488:0@lo:104: 00010000:00010000:3.0:1789478404.788154:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc34f77800/0x8ebaae74e8215c8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215c84 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478404.788172:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc34f77800/0x8ebaae74e8215c8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215c84 expref: 23 pid: 6511 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478404.788180:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c94c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876403964399616:0@lo:104: 00010000:00010000:3.0:1789478404.788203:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc34f76400/0x8ebaae74e8215c61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215c5a expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478404.788211:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc34f76400/0x8ebaae74e8215c61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215c5a expref: 23 pid: 6510 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478404.788219:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c94d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876403964399744:0@lo:104: 00000100:00100000:3.0:1789478404.788237:0:10329:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40fdbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789478404.788260:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876403964398080:192.168.206.11@tcp:104: 00000100:00100000:3.0:1789478404.788281:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08886300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876403964398208:192.168.206.11@tcp:104: 00000100:00100000:3.0:1789478404.788289:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876403964398336:0@lo:104: 00000100:00100000:3.0:1789478404.788297:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876403964398464:0@lo:104: 00000100:00100000:3.0:1789478404.788306:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876403964398592:0@lo:104: 00000100:00100000:1.0:1789478404.788480:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789478404.788498:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478404.788525:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478404.788548:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478404.788560:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478404.788568:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478404.788577:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964399104 00000100:00100000:1.0:1789478404.788581:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964399104 00000100:00100000:1.0:1789478404.788628:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964399232 00000100:00100000:1.0:1789478404.788632:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964399232 00000100:00100000:1.0:1789478404.788643:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964399360 00000100:00100000:1.0:1789478404.788646:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964399360 00000100:00100000:1.0:1789478404.788655:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964399488 00000100:00100000:1.0:1789478404.788657:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964399488 00000100:00100000:1.0:1789478404.788665:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964399616 00000100:00100000:1.0:1789478404.788668:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964399616 00000100:00100000:1.0:1789478404.788677:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964399744 00000100:00100000:1.0:1789478404.788680:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964399744 00000100:00100000:1.0:1789478404.788692:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789478404.788699:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+8:10329:x1876403964399104:12345-0@lo:104: 00010000:00010000:1.0:1789478404.788709:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcee00/0x8ebaae74e8215cfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215d02 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.788755:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789478404.788766:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+8:10329:x1876403964399104:12345-0@lo:104: Request processed in 67us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478404.788773:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789478404.788808:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789478404.788815:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c897100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+7:10329:x1876403964399232:12345-0@lo:104: 00010000:00010000:1.0:1789478404.788822:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8215cdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215ce6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.788869:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789478404.788875:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c897100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+7:10329:x1876403964399232:12345-0@lo:104: Request processed in 61us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478404.788881:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789478404.789130:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789478404.789137:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c894700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+6:10329:x1876403964399360:12345-0@lo:104: 00010000:00010000:1.0:1789478404.789145:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec200/0x8ebaae74e8215cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215cd8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789238:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789478404.789243:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c894700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+6:10329:x1876403964399360:12345-0@lo:104: Request processed in 108us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478404.789251:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789478404.789263:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789478404.789269:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+5:10329:x1876403964399488:12345-0@lo:104: 00010000:00010000:1.0:1789478404.789275:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215cc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215cca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789299:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789478404.789313:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+5:10329:x1876403964399488:12345-0@lo:104: Request processed in 44us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478404.789319:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789478404.789332:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789478404.789336:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+4:10329:x1876403964399616:12345-0@lo:104: 00010000:00010000:1.0:1789478404.789343:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76c00/0x8ebaae74e8215c84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215c8b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789369:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789478404.789373:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+4:10329:x1876403964399616:12345-0@lo:104: Request processed in 38us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478404.789379:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789478404.789389:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789478404.789394:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+3:10329:x1876403964399744:12345-0@lo:104: 00010000:00010000:1.0:1789478404.789401:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76e00/0x8ebaae74e8215c5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215c61 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789425:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1789478404.789430:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+3:10329:x1876403964399744:12345-0@lo:104: Request processed in 36us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478404.789434:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1789478404.789451:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1789478404.789456:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcee00/0x8ebaae74e8215cfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215d02 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789463:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcee00 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:1.0:1789478404.789466:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcee00/0x8ebaae74e8215cfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215d02 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789483:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcee00/0x8ebaae74e8215cfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215d02 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478404.789489:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcee00/0x8ebaae74e8215cfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215d02 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478404.789493:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789478404.789521:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcee00/0x8ebaae74e8215cfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215d02 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789527:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789478404.789543:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcee00/0x8ebaae74e8215cfb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215d02 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789549:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcee00/0x8ebaae74e8215cfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215d02 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789562:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789478404.789564:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8215cdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215ce6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789569:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b66e00 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:1.0:1789478404.789572:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8215cdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215ce6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789577:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8215cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215ce6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478404.789582:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8215cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215ce6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478404.789617:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789478404.789631:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8215cdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215ce6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789638:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789478404.789648:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8215cdf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215ce6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789653:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8215cdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215ce6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789661:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789478404.789664:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec200/0x8ebaae74e8215cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215cd8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789668:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc421ec200 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:1.0:1789478404.789671:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec200/0x8ebaae74e8215cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215cd8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789676:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec200/0x8ebaae74e8215cd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215cd8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478404.789682:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec200/0x8ebaae74e8215cd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215cd8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478404.789687:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789478404.789698:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec200/0x8ebaae74e8215cd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215cd8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789703:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789478404.789714:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec200/0x8ebaae74e8215cd1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215cd8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789720:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec200/0x8ebaae74e8215cd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215cd8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789728:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789478404.789731:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215cc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215cca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789736:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76600 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:1.0:1789478404.789739:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215cc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215cca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789745:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215cc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215cca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478404.789751:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215cc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215cca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478404.789756:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789478404.789769:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215cc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215cca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789774:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789478404.789779:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215cc3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215cca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789785:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215cc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215cca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789793:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789478404.789801:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76c00/0x8ebaae74e8215c84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215c8b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789805:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76c00 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:1.0:1789478404.789808:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76c00/0x8ebaae74e8215c84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215c8b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789814:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76c00/0x8ebaae74e8215c84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215c8b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478404.789819:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76c00/0x8ebaae74e8215c84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215c8b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478404.789824:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789478404.789836:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76c00/0x8ebaae74e8215c84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215c8b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789841:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789478404.789844:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76c00/0x8ebaae74e8215c84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215c8b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789849:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76c00/0x8ebaae74e8215c84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215c8b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789856:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789478404.789859:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76e00/0x8ebaae74e8215c5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215c61 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789864:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76e00 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:1.0:1789478404.789866:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76e00/0x8ebaae74e8215c5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215c61 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789880:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76e00/0x8ebaae74e8215c5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215c61 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478404.789962:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76e00/0x8ebaae74e8215c5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215c61 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478404.789967:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789478404.789981:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76e00/0x8ebaae74e8215c5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215c61 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789986:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789478404.789990:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76e00/0x8ebaae74e8215c5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215c61 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.789996:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76e00/0x8ebaae74e8215c5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215c61 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478404.790015:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478404.790016:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478404.790018:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478404.790025:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478404.790040:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964400128:0@lo:103: 00010000:00010000:1.0:1789478404.790075:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478404.790314:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c94df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876403964399104:0@lo:104: 00000100:00100000:3.0:1789478404.790324:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c94dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876403964399232:0@lo:104: 00000100:00100000:3.0:1789478404.790330:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c94f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876403964399360:0@lo:104: 00000100:00100000:3.0:1789478404.790336:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c94f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876403964399488:0@lo:104: 00000100:00100000:3.0:1789478404.790343:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c94c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876403964399616:0@lo:104: 00000100:00100000:3.0:1789478404.790350:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c94d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876403964399744:0@lo:104: 00010000:00010000:3.0:1789478404.790387:0:10329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ebc34f77000/0x8ebaae74e8215dc6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478404.790532:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964400000:0@lo:103: 00000100:00100000:0.0:1789478404.790557:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478404.790768:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964398720 00000100:00100000:2.0:1789478404.790775:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964398720 00010000:00010000:3.0:1789478404.790864:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc34f76200/0x8ebaae74e8215d72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215d6b expref: 24 pid: 6512 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478404.790993:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964398848 00000100:00100000:3.0:1789478404.790997:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964398848 00010000:00010000:3.0:1789478404.791010:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc35b67a00/0x8ebaae74e8215d48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215d41 expref: 25 pid: 6512 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478404.791050:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789478404.791061:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08c63450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+25:3645:x1876403964398720:12345-0@lo:103: 00010000:00010000:2.0:1789478404.791072:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478404.791079:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc34f76200/0x8ebaae74e8215d72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215d6b expref: 25 pid: 6512 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.791088:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc34f76200/0x8ebaae74e8215d72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215d6b expref: 25 pid: 6512 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.791102:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc34f76200/0x8ebaae74e8215d72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215d6b expref: 25 pid: 6512 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.791126:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478404.791170:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08c63450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3645:x1876403964398720:12345-0@lo:103: Request processed in 112us (4285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478404.791177:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789478404.791218:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789478404.791224:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+23:3645:x1876403964398848:12345-0@lo:103: 00010000:00010000:2.0:1789478404.791232:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478404.791236:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc35b67a00/0x8ebaae74e8215d48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215d41 expref: 23 pid: 6512 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.791244:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc35b67a00/0x8ebaae74e8215d48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215d41 expref: 23 pid: 6512 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.791255:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc35b67a00/0x8ebaae74e8215d48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215d41 expref: 23 pid: 6512 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.791262:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478404.791284:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+22:3645:x1876403964398848:12345-0@lo:103: Request processed in 60us (4055us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478404.791290:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789478404.791403:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964400512:0@lo:103: 00000100:00100000:0.0:1789478404.791427:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478404.791449:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964398848:0@lo:103: 00000100:00100000:0.0:1789478404.791457:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964398720:0@lo:103: 00000100:00100000:0.0:1789478404.791480:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964399872:0@lo:103: 00000100:00100000:0.0:1789478404.791501:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478404.791511:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964400384:0@lo:103: 00000100:00100000:0.0:1789478404.791524:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478404.791533:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789478404.791538:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964400256:0@lo:103: 00000100:00100000:0.0:1789478404.791550:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478404.791590:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964400000 00000100:00100000:0.0:1789478404.791622:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964400000 00010000:00010000:0.0:1789478404.791638:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc42176c00/0x8ebaae74e8215ce6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215cdf expref: 22 pid: 6511 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478404.791652:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964400512 00000100:00100000:0.0:1789478404.791655:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964400512 00010000:00010000:0.0:1789478404.791664:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc34f76400/0x8ebaae74e8215c61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215c5a expref: 23 pid: 6510 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478404.791673:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964399872 00000100:00100000:0.0:1789478404.791675:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964399872 00010000:00010000:0.0:1789478404.791685:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc40fcf200/0x8ebaae74e8215d02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215cfb expref: 24 pid: 6511 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478404.791693:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964400384 00000100:00100000:0.0:1789478404.791695:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964400384 00010000:00010000:0.0:1789478404.791702:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc34f77800/0x8ebaae74e8215c8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215c84 expref: 25 pid: 6511 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478404.791711:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964400256 00000100:00100000:0.0:1789478404.791713:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964400256 00010000:00010000:0.0:1789478404.791722:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc42177000/0x8ebaae74e8215cca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215cc3 expref: 26 pid: 6510 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478404.791734:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789478404.791740:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+26:3645:x1876403964400000:12345-0@lo:103: 00010000:00010000:0.0:1789478404.791747:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478404.791751:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc42176c00/0x8ebaae74e8215ce6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215cdf expref: 26 pid: 6511 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.791759:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc42176c00/0x8ebaae74e8215ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215cdf expref: 26 pid: 6511 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.791777:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc42176c00/0x8ebaae74e8215ce6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215cdf expref: 26 pid: 6511 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.791788:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478404.791817:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+25:3645:x1876403964400000:12345-0@lo:103: Request processed in 78us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478404.791824:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789478404.791836:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789478404.791842:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3645:x1876403964400512:12345-0@lo:103: 00010000:00010000:0.0:1789478404.791848:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478404.791852:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc34f76400/0x8ebaae74e8215c61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215c5a expref: 24 pid: 6510 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.791859:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc34f76400/0x8ebaae74e8215c61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215c5a expref: 24 pid: 6510 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.791867:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc34f76400/0x8ebaae74e8215c61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215c5a expref: 24 pid: 6510 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.791875:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478404.791916:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+23:3645:x1876403964400512:12345-0@lo:103: Request processed in 73us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478404.791922:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789478404.791933:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789478404.791939:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+22:3648:x1876403964399872:12345-0@lo:103: 00010000:00010000:0.0:1789478404.791945:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478404.791949:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc40fcf200/0x8ebaae74e8215d02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215cfb expref: 22 pid: 6511 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.791963:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc40fcf200/0x8ebaae74e8215d02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215cfb expref: 22 pid: 6511 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.791973:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc40fcf200/0x8ebaae74e8215d02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215cfb expref: 22 pid: 6511 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.791981:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478404.792006:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+21:3648:x1876403964399872:12345-0@lo:103: Request processed in 68us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478404.792011:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789478404.792023:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789478404.792030:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+20:3648:x1876403964400384:12345-0@lo:103: 00010000:00010000:0.0:1789478404.792036:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478404.792041:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc34f77800/0x8ebaae74e8215c8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215c84 expref: 20 pid: 6511 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.792049:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc34f77800/0x8ebaae74e8215c8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215c84 expref: 20 pid: 6511 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.792058:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc34f77800/0x8ebaae74e8215c8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215c84 expref: 20 pid: 6511 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.792065:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478404.792083:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+19:3648:x1876403964400384:12345-0@lo:103: Request processed in 54us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478404.792088:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789478404.792098:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789478404.792103:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+18:3648:x1876403964400256:12345-0@lo:103: 00010000:00010000:0.0:1789478404.792117:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478404.792122:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc42177000/0x8ebaae74e8215cca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215cc3 expref: 18 pid: 6510 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.792130:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc42177000/0x8ebaae74e8215cca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215cc3 expref: 18 pid: 6510 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.792139:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc42177000/0x8ebaae74e8215cca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215cc3 expref: 18 pid: 6510 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.792148:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478404.792181:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+17:3648:x1876403964400256:12345-0@lo:103: Request processed in 77us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478404.792187:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789478404.792213:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964400256:0@lo:103: 00000100:00100000:0.0:1789478404.792220:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964399872:0@lo:103: 00000100:00100000:0.0:1789478404.792226:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964400384:0@lo:103: 00000100:00100000:0.0:1789478404.792253:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478404.792283:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964400128 00000100:00100000:0.0:1789478404.792287:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964400128 00010000:00010000:0.0:1789478404.792299:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215cd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215cd1 expref: 17 pid: 6512 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478404.792312:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789478404.792317:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+17:3646:x1876403964400128:12345-0@lo:103: 00010000:00010000:0.0:1789478404.792324:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478404.792327:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215cd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215cd1 expref: 17 pid: 6512 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.792341:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215cd1 expref: 17 pid: 6512 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.792352:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc421eca00/0x8ebaae74e8215cd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215cd1 expref: 17 pid: 6512 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.792362:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478404.792388:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c56e5039-4535-4d8a-bd01-962355b55f9c+16:3646:x1876403964400128:12345-0@lo:103: Request processed in 71us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478404.792394:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789478404.792417:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964400128:0@lo:103: 00000100:00100000:0.0:1789478404.792435:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964400000:0@lo:103: 00000100:00100000:0.0:1789478404.792442:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964400512:0@lo:103: 00000100:00100000:1.0:1789478404.792853:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478404.792986:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478404.793069:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478404.793120:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964398976 00000100:00100000:2.0:1789478404.793125:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964398976 00010000:00010000:2.0:1789478404.793147:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc35b67200/0x8ebaae74e8215d2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215d25 expref: 16 pid: 6511 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478404.793179:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945476736 00000100:00100000:2.0:1789478404.793183:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945476736 00010000:00010000:2.0:1789478404.793196:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc00031000/0x8ebaae74e8215d87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7150 expref: 10 pid: 6511 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478404.793223:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789478404.793230:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+16:3647:x1876403964398976:12345-0@lo:103: 00010000:00010000:2.0:1789478404.793239:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478404.793243:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc35b67200/0x8ebaae74e8215d2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215d25 expref: 16 pid: 6511 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.793251:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc35b67200/0x8ebaae74e8215d2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215d25 expref: 16 pid: 6511 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.793262:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc35b67200/0x8ebaae74e8215d2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215d25 expref: 16 pid: 6511 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.793271:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478404.793303:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+15:3647:x1876403964398976:12345-0@lo:103: Request processed in 74us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478404.793309:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789478404.793324:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 33 00000100:00100000:2.0:1789478404.793332:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08c60050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:2395:x1876403945476736:12345-192.168.206.11@tcp:103: 00010000:00010000:2.0:1789478404.793339:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478404.793343:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc00031000/0x8ebaae74e8215d87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7150 expref: 10 pid: 6511 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.793352:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc00031000/0x8ebaae74e8215d87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7150 expref: 10 pid: 6511 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.793363:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc00031000/0x8ebaae74e8215d87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7150 expref: 10 pid: 6511 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478404.793382:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478404.793416:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08c60050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+9:2395:x1876403945476736:12345-192.168.206.11@tcp:103: Request processed in 85us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478404.793423:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 33 00000100:00100000:0.0:1789478404.793665:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945476864 00000100:00100000:0.0:1789478404.793669:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945476864 00010000:00010000:0.0:1789478404.793685:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215d80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7149 expref: 9 pid: 6510 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478404.793704:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 34 00000100:00100000:0.0:1789478404.793711:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+9:2397:x1876403945476864:12345-192.168.206.11@tcp:103: 00010000:00010000:0.0:1789478404.793718:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478404.793722:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215d80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7149 expref: 9 pid: 6510 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.793731:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7149 expref: 9 pid: 6510 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.793752:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc34f77a00/0x8ebaae74e8215d80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7149 expref: 9 pid: 6510 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.793764:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ebc34f77000/0x8ebaae74e8215dc6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.793773:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc34f77000/0x8ebaae74e8215dc6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.793786:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc34f77000/0x8ebaae74e8215dc6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.793794:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc34f77000/0x8ebaae74e8215dc6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.793802:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ebc34f77000/0x8ebaae74e8215dc6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.793808:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ebc34f77000/0x8ebaae74e8215dc6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.793814:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77000 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:0.0:1789478404.793819:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ebc34f77000/0x8ebaae74e8215dc6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.793827:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ebc34f77000/0x8ebaae74e8215dc6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.793841:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ebc34f77000/0x8ebaae74e8215dc6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478404.793860:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478404.793879:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+8:2397:x1876403945476864:12345-192.168.206.11@tcp:103: Request processed in 168us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478404.793902:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 34 00000100:00100000:0.0:1789478404.793932:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964398976:0@lo:103: 00010000:00010000:3.0:1789478404.794687:0:10329:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ebc34f77000/0x8ebaae74e8215dc6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478404.794697:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ebc34f77000/0x8ebaae74e8215dc6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478404.794712:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc34f77000/0x8ebaae74e8215dc6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478404.843498:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964400640:0@lo:41: 00000100:00100000:0.0:1789478404.843570:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478404.845036:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789478404.845053:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964400768:0@lo:41: 00000100:00100000:0.0:1789478404.845101:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478404.845154:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964400640 00000100:00100000:0.0:1789478404.845161:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964400640 00000100:00100000:0.0:1789478404.845197:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964400768 00000100:00100000:0.0:1789478404.845200:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964400768 00000100:00100000:0.0:1789478404.845216:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789478404.845224:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964400640:12345-0@lo:41: 00000004:00000024:0.0:1789478404.845255:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789478404.845301:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964400640:12345-0@lo:41: Request processed in 77us (1731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478404.845308:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789478404.845325:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789478404.845333:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964400768:12345-0@lo:41: 00000004:00000024:0.0:1789478404.845349:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789478404.845384:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964400768:12345-0@lo:41: Request processed in 52us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478404.845406:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789478404.845448:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964400768:0@lo:41: 00000100:00100000:0.0:1789478404.845558:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964400640:0@lo:41: 00000100:00100000:3.0:1789478404.854341:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789478404.854362:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c94d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964400896:0@lo:400: 00000100:00100000:3.0:1789478404.854434:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478404.854493:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964400896 00000100:00100000:3.0:1789478404.854501:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964400896 00000100:00100000:3.0:1789478404.854545:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789478404.854554:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964400896:12345-0@lo:400: 00000100:00100000:3.0:1789478404.854634:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964400896:12345-0@lo:400: Request processed in 82us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478404.854641:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789478404.854678:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c94d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964400896:0@lo:400: 00000100:00100000:3.0:1789478404.854722:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c94d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964401024:0@lo:400: 00000100:00100000:3.0:1789478404.854747:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478404.854773:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964401024 00000100:00100000:3.0:1789478404.854777:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964401024 00000100:00100000:3.0:1789478404.854803:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789478404.854810:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964401024:12345-0@lo:400: 00000100:00100000:3.0:1789478404.854848:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964401024:12345-0@lo:400: Request processed in 38us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478404.854854:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789478404.854878:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c94d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964401024:0@lo:400: 00000100:00100000:3.0:1789478404.854917:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789478404.854935:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c94d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964401152:0@lo:400: 00000100:00100000:3.0:1789478404.854961:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478404.854985:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964401152 00000100:00100000:3.0:1789478404.854989:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964401152 00000100:00100000:3.0:1789478404.855018:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789478404.855024:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964401152:12345-0@lo:400: 00000100:00100000:3.0:1789478404.855060:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964401152:12345-0@lo:400: Request processed in 35us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478404.855066:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1789478404.855080:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789478404.855096:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c94d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964401152:0@lo:400: 00000100:00100000:3.0:1789478404.855121:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c94d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964401280:0@lo:400: 00000100:00100000:3.0:1789478404.855140:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478404.855161:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964401280 00000100:00100000:3.0:1789478404.855165:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964401280 00000100:00100000:3.0:1789478404.855190:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789478404.855197:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964401280:12345-0@lo:400: 00000100:00100000:3.0:1789478404.855230:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964401280:12345-0@lo:400: Request processed in 34us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478404.855236:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1789478404.855249:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789478404.855268:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c94d180 x1876403964401280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478404.855277:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c94d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964401280:0@lo:400: 00000100:00100000:3.0:1789478404.855304:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789478404.855309:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c94d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964401408:0@lo:400: 00000100:00100000:3.0:1789478404.855342:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478404.855370:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964401408 00000100:00100000:3.0:1789478404.855373:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964401408 00000100:00100000:3.0:1789478404.855397:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789478404.855402:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964401408:12345-0@lo:400: 00000100:00100000:3.0:1789478404.855429:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964401408:12345-0@lo:400: Request processed in 27us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478404.855434:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789478404.855462:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c94d180 x1876403964401408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478404.855472:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c94d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964401408:0@lo:400: 00000100:00100000:3.0:1789478404.855507:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c94d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964401536:0@lo:400: 00000100:00100000:3.0:1789478404.855532:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478404.855559:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964401536 00000100:00100000:3.0:1789478404.855562:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964401536 00000100:00100000:3.0:1789478404.855586:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789478404.855590:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964401536:12345-0@lo:400: 00000100:00100000:3.0:1789478404.855648:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964401536:12345-0@lo:400: Request processed in 57us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478404.855655:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1789478404.855670:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789478404.855685:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c94d180 x1876403964401536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478404.855693:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c94d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964401536:0@lo:400: 00000100:00100000:3.0:1789478404.855717:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789478404.855722:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c94d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964401664:0@lo:400: 00000100:00100000:3.0:1789478404.855751:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478404.855771:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964401664 00000100:00100000:3.0:1789478404.855775:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964401664 00000100:00100000:3.0:1789478404.855797:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789478404.855803:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964401664:12345-0@lo:400: 00000100:00100000:3.0:1789478404.855834:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964401664:12345-0@lo:400: Request processed in 31us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478404.855839:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1789478404.855851:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789478404.855868:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c94d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964401664:0@lo:400: 00000100:00100000:3.0:1789478404.855911:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c94d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964401792:0@lo:400: 00000100:00100000:3.0:1789478404.855931:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478404.855952:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964401792 00000100:00100000:3.0:1789478404.855956:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964401792 00000100:00100000:3.0:1789478404.855978:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789478404.855983:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964401792:12345-0@lo:400: 00000100:00100000:3.0:1789478404.856012:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964401792:12345-0@lo:400: Request processed in 29us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478404.856017:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1789478404.856027:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789478404.856042:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c94d180 x1876403964401792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478404.856050:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c94d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964401792:0@lo:400: 00000100:00100000:3.0:1789478404.856074:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789478404.856080:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c94d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964401920:0@lo:400: 00000100:00100000:3.0:1789478404.856102:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478404.856129:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964401920 00000100:00100000:3.0:1789478404.856133:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964401920 00000100:00100000:3.0:1789478404.856155:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789478404.856160:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964401920:12345-0@lo:400: 00000100:00100000:3.0:1789478404.856191:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964401920:12345-0@lo:400: Request processed in 30us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478404.856197:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789478404.856208:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789478404.856224:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c94d180 x1876403964401920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478404.856231:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789478404.856241:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c94d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964401920:0@lo:400: 00000100:00100000:3.0:1789478404.856269:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c94d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964402048:0@lo:400: 00000100:00100000:3.0:1789478404.856292:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478404.856313:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964402048 00000100:00100000:3.0:1789478404.856316:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964402048 00000100:00100000:3.0:1789478404.856338:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789478404.856344:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964402048:12345-0@lo:400: 00000100:00100000:3.0:1789478404.856369:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964402048:12345-0@lo:400: Request processed in 26us (78us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478404.856374:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1789478404.856385:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789478404.856398:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c94d180 x1876403964402048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478404.856405:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1789478404.856414:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c94d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964402048:0@lo:400: 00000100:00100000:0.0:1789478405.348994:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789478405.349019:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964402176:0@lo:13: 00000100:00100000:0.0:1789478405.349085:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478405.349494:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964402304:0@lo:13: 00000100:00100000:0.0:1789478405.349537:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478405.349679:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964402176 00000100:00100000:2.0:1789478405.349687:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964402176 00000100:00100000:2.0:1789478405.349725:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964402304 00000100:00100000:2.0:1789478405.349727:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964402304 00000100:00100000:2.0:1789478405.349743:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789478405.349752:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964402176:12345-0@lo:13: 00002000:00000024:2.0:1789478405.349794:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789478405.349849:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964402176:12345-0@lo:13: Request processed in 98us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478405.349857:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789478405.349874:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789478405.349892:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964402304:12345-0@lo:13: 00002000:00000024:2.0:1789478405.349902:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789478405.349947:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964402304:12345-0@lo:13: Request processed in 52us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478405.349954:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1789478405.349988:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03599f80 x1876403964402304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478405.350006:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964402304:0@lo:13: 00010000:00080000:0.0:1789478405.350421:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb036d5500 x1876403964402176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478405.350438:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964402176:0@lo:13: 00000100:00100000:1.0:1789478405.441559:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478405.441694:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945476992 00000100:00100000:2.0:1789478405.441703:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945476992 00000100:00100000:2.0:1789478405.441769:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 197 00000100:00100000:2.0:1789478405.441779:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+8:6164:x1876403945476992:12345-192.168.206.11@tcp:101: 00010000:00010000:2.0:1789478405.441908:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478405.441928:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc34f76200/0x8ebaae74e8215dcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b71c0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478405.441954:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc34f76200/0x8ebaae74e8215dcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b71c0 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478405.441965:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc34f76200/0x8ebaae74e8215dcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b71c0 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478405.442079:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76200, rc 0) 00000100:00100000:2.0:1789478405.442432:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+9:6164:x1876403945476992:12345-192.168.206.11@tcp:101: Request processed in 654us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478405.442439:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 197 00000100:00100000:1.0:1789478405.450760:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478405.451078:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945477120 00000100:00100000:0.0:1789478405.451087:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945477120 00000100:00100000:0.0:1789478405.451177:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 198 00000100:00100000:0.0:1789478405.451187:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+9:6164:x1876403945477120:12345-192.168.206.11@tcp:501: 00000100:00100000:0.0:1789478405.451376:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+9:6164:x1876403945477120:12345-192.168.206.11@tcp:501: Request processed in 190us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478405.451392:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 198 00000100:00100000:1.0:1789478405.457897:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478405.458007:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945477248 00000100:00100000:2.0:1789478405.458026:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945477248 00000100:00100000:2.0:1789478405.458079:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 199 00000100:00100000:2.0:1789478405.458089:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+9:6164:x1876403945477248:12345-192.168.206.11@tcp:503: 00000100:00100000:2.0:1789478405.458223:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+9:6164:x1876403945477248:12345-192.168.206.11@tcp:503: Request processed in 135us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478405.458231:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 199 00000100:00100000:3.0:1789478405.464449:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478405.464773:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945477376 00000100:00100000:0.0:1789478405.464782:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945477376 00000100:00100000:0.0:1789478405.464832:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 200 00000100:00100000:0.0:1789478405.464841:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+9:6638:x1876403945477376:12345-192.168.206.11@tcp:502: 00000100:00100000:0.0:1789478405.464990:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+9:6638:x1876403945477376:12345-192.168.206.11@tcp:502: Request processed in 149us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478405.465007:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 200 00000100:00100000:3.0:1789478405.467676:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478405.467765:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945477504 00000100:00100000:1.0:1789478405.467774:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945477504 00000100:00100000:1.0:1789478405.467826:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 201 00000100:00100000:1.0:1789478405.467842:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+9:6638:x1876403945477504:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789478405.467989:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+9:6638:x1876403945477504:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 153us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478405.467996:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 201 00000100:00100000:1.0:1789478405.475230:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478405.475323:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945477632 00000100:00100000:2.0:1789478405.475331:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945477632 00000100:00100000:2.0:1789478405.475392:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 202 00000100:00100000:2.0:1789478405.475401:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+9:6164:x1876403945477632:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789478405.475428:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478405.475443:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc34f77200/0x8ebaae74e8215dd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b71c7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478405.475467:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc34f77200/0x8ebaae74e8215dd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b71c7 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478405.475477:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc34f77200/0x8ebaae74e8215dd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b71c7 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478405.475486:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f77200, rc 0) 00000100:00100000:2.0:1789478405.475536:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:6164:x1876403945477632:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 Request processed in 135us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478405.475543:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 202 00000100:00100000:3.0:1789478405.477225:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478405.477326:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945477760 00000100:00100000:0.0:1789478405.477333:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945477760 00000100:00100000:0.0:1789478405.477574:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 203 00000100:00100000:0.0:1789478405.477586:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:6164:x1876403945477760:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789478405.477752:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:6164:x1876403945477760:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 Request processed in 168us (532us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789478405.477760:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 203 00010000:00010000:1.0:1789478405.668972:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789478406.052721:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789478406.052729:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ebc3f6c1800 from 48 10000000:01000000:2.0:1789478406.052734:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789478406.052791:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76a00/0x8ebaae74e8215ddb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.052803:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76a00/0x8ebaae74e8215ddb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.052815:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76a00/0x8ebaae74e8215ddb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478406.052975:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964402432:0@lo:101: 00000100:00100000:2.0:1789478406.053125:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478406.053540:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964402432 00000100:00100000:3.0:1789478406.053548:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964402432 00000100:00100000:2.0:1789478406.053674:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40fdb840 going to sleep for 11 seconds 00000100:00100000:3.0:1789478406.054344:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789478406.054356:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+15:6514:x1876403964402432:12345-0@lo:101: 00010000:00010000:3.0:1789478406.054370:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478406.054395:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc00031800/0x8ebaae74e8215de2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215ddb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.054421:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc00031800/0x8ebaae74e8215de2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215ddb expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.054430:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc00031800/0x8ebaae74e8215de2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215ddb expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.054439:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc00031800, rc 0) 00000100:00100000:3.0:1789478406.054498:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:6514:x1876403964402432:12345-0@lo:101: Request processed in 145us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478406.054505:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789478406.057419:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964402432:0@lo:101: 00010000:00010000:0.0:1789478406.057445:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76a00/0x8ebaae74e8215ddb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215de2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478406.057458:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76a00/0x8ebaae74e8215ddb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215de2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478406.057531:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964402560:0@lo:501: 00000100:00100000:0.0:1789478406.057618:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478406.057655:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34de16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478406.058059:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964402560 00000100:00100000:1.0:1789478406.058066:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964402560 00000100:00100000:1.0:1789478406.058114:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789478406.058124:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:6514:x1876403964402560:12345-0@lo:501: 00000100:00100000:0.0:1789478406.058325:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964402560:0@lo:501: 00000100:00100000:1.0:1789478406.058326:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:6514:x1876403964402560:12345-0@lo:501: Request processed in 201us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478406.058336:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789478406.058382:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964402688:0@lo:503: 00000100:00100000:0.0:1789478406.058438:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478406.058460:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34de16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478406.058491:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964402688 00000100:00100000:3.0:1789478406.058497:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964402688 00000100:00100000:3.0:1789478406.058526:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789478406.058532:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:6514:x1876403964402688:12345-0@lo:503: 00000100:00100000:3.0:1789478406.058932:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:6514:x1876403964402688:12345-0@lo:503: Request processed in 398us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478406.058939:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789478406.059029:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964402688:0@lo:503: 00000100:00100000:3.0:1789478406.065511:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10347:1876403964402816:0@lo:502: 00000100:00100000:3.0:1789478406.065590:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478406.065656:0:10347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0355ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789478406.065937:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964402816 00000100:00100000:1.0:1789478406.065943:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964402816 00000100:00100000:1.0:1789478406.065990:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789478406.065999:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:10347:x1876403964402816:12345-0@lo:502: 00000100:00100000:1.0:1789478406.066118:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+16:10347:x1876403964402816:12345-0@lo:502: Request processed in 120us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478406.066124:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789478406.066507:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10347:1876403964402816:0@lo:502: 00000100:00100000:3.0:1789478406.066548:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10347:1876403964402944:0@lo:502: 00000100:00100000:3.0:1789478406.066690:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478406.066721:0:10347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0355ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789478406.066934:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964402944 00000100:00100000:1.0:1789478406.066940:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964402944 00000100:00100000:1.0:1789478406.066974:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789478406.066981:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:10347:x1876403964402944:12345-0@lo:502: 00000100:00100000:1.0:1789478406.067072:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+16:10347:x1876403964402944:12345-0@lo:502: Request processed in 91us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478406.067080:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789478406.067369:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10347:1876403964402944:0@lo:502: 00000040:00080000:0.0:1789478406.067466:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789478406.067697:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789478406.067719:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789478406.067728:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76a00/0x8ebaae74e8215ddb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215de2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.067738:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76a00/0x8ebaae74e8215ddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215de2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478406.068321:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789478406.068324:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1789478406.068327:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789478406.068354:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce000/0x8ebaae74e8215de9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.068362:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce000/0x8ebaae74e8215de9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.068372:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce000/0x8ebaae74e8215de9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478406.068459:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964403072:0@lo:101: 00000100:00100000:1.0:1789478406.068501:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478406.068537:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f2780 going to sleep for 11 seconds 00000100:00100000:0.0:1789478406.068722:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964403072 00000100:00100000:0.0:1789478406.068728:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964403072 00000100:00100000:0.0:1789478406.068944:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789478406.068953:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+16:6514:x1876403964403072:12345-0@lo:101: 00010000:00010000:0.0:1789478406.068964:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478406.068977:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc35b67000/0x8ebaae74e8215df0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215de9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478406.068998:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc35b67000/0x8ebaae74e8215df0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215de9 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478406.069008:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc35b67000/0x8ebaae74e8215df0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215de9 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478406.069017:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b67000, rc 0) 00000100:00100000:0.0:1789478406.069065:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+17:6514:x1876403964403072:12345-0@lo:101: Request processed in 114us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478406.069072:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789478406.069425:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964403072:0@lo:101: 00010000:00010000:3.0:1789478406.069440:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce000/0x8ebaae74e8215de9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215df0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.069450:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce000/0x8ebaae74e8215de9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215df0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478406.069505:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964403200:0@lo:501: 00000100:00100000:3.0:1789478406.069534:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478406.069576:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0355a540 going to sleep for 11 seconds 00000100:00100000:1.0:1789478406.070353:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964403200 00000100:00100000:1.0:1789478406.070360:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964403200 00000100:00100000:1.0:1789478406.070470:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789478406.070479:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+17:6514:x1876403964403200:12345-0@lo:501: 00000100:00100000:1.0:1789478406.071048:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+17:6514:x1876403964403200:12345-0@lo:501: Request processed in 569us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478406.071056:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789478406.071140:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964403200:0@lo:501: 00000100:00100000:3.0:1789478406.071464:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964403328:0@lo:503: 00000100:00100000:3.0:1789478406.071504:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478406.071539:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0355a540 going to sleep for 11 seconds 00000100:00100000:1.0:1789478406.071957:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964403328 00000100:00100000:1.0:1789478406.071963:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964403328 00000100:00100000:1.0:1789478406.071992:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789478406.072000:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+17:6514:x1876403964403328:12345-0@lo:503: 00000100:00100000:1.0:1789478406.072114:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+17:6514:x1876403964403328:12345-0@lo:503: Request processed in 114us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478406.072121:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789478406.072341:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964403328:0@lo:503: 00000100:00100000:0.0:1789478406.081358:0:10348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10348:1876403964403456:0@lo:502: 00000100:00100000:1.0:1789478406.081525:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478406.081621:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964403456 00000100:00100000:3.0:1789478406.081630:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964403456 00000100:00100000:3.0:1789478406.081682:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789478406.081693:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+17:10348:x1876403964403456:12345-0@lo:502: 00000100:00100000:1.0:1789478406.082107:0:10348:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34de1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789478406.083361:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+17:10348:x1876403964403456:12345-0@lo:502: Request processed in 1665us (1831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478406.083372:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789478406.084434:0:10348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10348:1876403964403456:0@lo:502: 00000020:01000000:1.0:1789478406.084470:0:10348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789478406.084479:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478406.084481:0:10348:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789478406.084486:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789478406.084520:0:10348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10348:1876403964403584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789478406.084568:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478406.084686:0:10348:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f2900 going to sleep for 11 seconds 00000100:00100000:3.0:1789478406.084817:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964403584 00000100:00100000:3.0:1789478406.084824:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964403584 00000100:00100000:3.0:1789478406.084871:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789478406.084890:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+17:10348:x1876403964403584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789478406.084997:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+17:10348:x1876403964403584:12345-0@lo:502:llog_process_th.0 Request processed in 118us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478406.085004:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789478406.085106:0:10348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10348:1876403964403584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789478406.085126:0:10348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789478406.085132:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478406.085133:0:10348:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789478406.085137:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:3.0:1789478406.085811:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1789478406.085832:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789478406.085841:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce000/0x8ebaae74e8215de9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215df0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.085851:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce000/0x8ebaae74e8215de9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215df0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478406.085859:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789478406.085861:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ebc40e0d800 from 48 10000000:01000000:3.0:1789478406.085864:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789478406.085898:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215df7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.085905:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215df7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.085915:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215df7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478406.085938:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964403712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789478406.085975:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478406.086011:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0355a240 going to sleep for 11 seconds 00000100:00100000:1.0:1789478406.086126:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964403712 00000100:00100000:1.0:1789478406.086131:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964403712 00000100:00100000:1.0:1789478406.086161:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789478406.086168:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+17:6514:x1876403964403712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789478406.086178:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478406.086190:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40fcec00/0x8ebaae74e8215dfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215df7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.086221:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40fcec00/0x8ebaae74e8215dfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215df7 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.086231:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40fcec00/0x8ebaae74e8215dfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215df7 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.086239:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcec00, rc 0) 00000100:00100000:1.0:1789478406.086579:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964403712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 410us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478406.086585:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789478406.087392:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964403712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789478406.087410:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215df7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215dfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.087420:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215df7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215dfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478406.087498:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964403840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789478406.087533:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478406.087558:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40fdb780 going to sleep for 11 seconds 00000100:00100000:1.0:1789478406.087626:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964403840 00000100:00100000:1.0:1789478406.087632:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964403840 00000100:00100000:1.0:1789478406.087673:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789478406.087681:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964403840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478406.087923:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964403840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478406.087931:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789478406.088352:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964403840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789478406.088382:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964403968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789478406.088420:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478406.088515:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40fdb780 going to sleep for 11 seconds 00000100:00100000:3.0:1789478406.090077:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964403968 00000100:00100000:3.0:1789478406.090089:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964403968 00000100:00100000:3.0:1789478406.090141:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789478406.090151:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964403968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789478406.090282:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964403968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (1860us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478406.090289:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789478406.090352:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964403968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789478406.091042:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10351:1876403964404096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789478406.091091:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478406.091129:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0355a600 going to sleep for 11 seconds 00000100:00100000:1.0:1789478406.091185:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964404096 00000100:00100000:1.0:1789478406.091190:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964404096 00000100:00100000:1.0:1789478406.091228:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789478406.091236:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+18:10351:x1876403964404096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789478406.091345:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+18:10351:x1876403964404096:12345-0@lo:502:llog_process_th.0 Request processed in 110us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478406.091353:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789478406.091478:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10351:1876403964404096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789478406.091519:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10351:1876403964404224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789478406.091553:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478406.091578:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40fdb000 going to sleep for 11 seconds 00000100:00100000:3.0:1789478406.091652:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964404224 00000100:00100000:3.0:1789478406.091656:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964404224 00000100:00100000:3.0:1789478406.091681:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789478406.091688:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+18:10351:x1876403964404224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789478406.091778:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+18:10351:x1876403964404224:12345-0@lo:502:llog_process_th.0 Request processed in 90us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478406.091785:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789478406.091914:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10351:1876403964404224:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789478406.091934:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789478406.092112:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789478406.092134:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789478406.092142:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215df7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215dfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.092158:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215dfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478406.092168:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789478406.092170:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1789478406.092173:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789478406.092194:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215e05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.092201:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215e05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.092210:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215e05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478406.092222:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964404352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789478406.092260:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478406.092320:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0355a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478406.093993:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964404352 00000100:00100000:2.0:1789478406.094003:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964404352 00000100:00100000:2.0:1789478406.094052:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789478406.094061:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+18:6514:x1876403964404352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789478406.094074:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478406.094094:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc34f77c00/0x8ebaae74e8215e0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215e05 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.094116:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc34f77c00/0x8ebaae74e8215e0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215e05 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.094127:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc34f77c00/0x8ebaae74e8215e0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215e05 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.094134:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f77c00, rc 0) 00000100:00100000:2.0:1789478406.094194:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+19:6514:x1876403964404352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (1946us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478406.094201:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789478406.094351:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964404352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789478406.094375:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215e05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.094384:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215e05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215e0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478406.094466:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964404480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478406.094498:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478406.094522:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f2000 going to sleep for 11 seconds 00000100:00100000:1.0:1789478406.094535:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964404480 00000100:00100000:1.0:1789478406.094538:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964404480 00000100:00100000:1.0:1789478406.094562:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789478406.094569:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+19:6514:x1876403964404480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478406.094686:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+19:6514:x1876403964404480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478406.094692:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789478406.094719:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964404480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478406.094758:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964404608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789478406.094793:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478406.094805:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f2000 going to sleep for 11 seconds 00000100:00100000:1.0:1789478406.094814:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964404608 00000100:00100000:1.0:1789478406.094817:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964404608 00000100:00100000:1.0:1789478406.094834:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789478406.094839:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+19:6514:x1876403964404608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789478406.094993:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+19:6514:x1876403964404608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478406.095008:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789478406.095043:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964404608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789478406.095236:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10352:1876403964404736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789478406.095396:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478406.095416:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964404736 00000100:00100000:1.0:1789478406.095419:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964404736 00000100:00100000:1.0:1789478406.095440:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789478406.095447:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+19:10352:x1876403964404736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789478406.095507:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+19:10352:x1876403964404736:12345-0@lo:502:llog_process_th.0 Request processed in 60us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478406.095513:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789478406.095540:0:10352:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f2540 going to sleep for 11 seconds 00000100:00100000:1.0:1789478406.095551:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10352:1876403964404736:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789478406.095572:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789478406.095580:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478406.095583:0:10352:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789478406.095587:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789478406.095624:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10352:1876403964404864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789478406.095653:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478406.095671:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964404864 00000100:00100000:1.0:1789478406.095675:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964404864 00000100:00100000:1.0:1789478406.095693:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789478406.095699:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+19:10352:x1876403964404864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789478406.097378:0:10352:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34f72540 going to sleep for 11 seconds 00000100:00100000:1.0:1789478406.097552:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+19:10352:x1876403964404864:12345-0@lo:502:llog_process_th.0 Request processed in 1850us (1896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478406.097571:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789478406.097683:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10352:1876403964404864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789478406.097713:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789478406.097719:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478406.097721:0:10352:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789478406.097727:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1789478406.098086:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789478406.098105:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789478406.098115:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215e05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.098125:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215e05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478406.098134:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789478406.098137:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ebc34d64800 from 48 10000000:01000000:1.0:1789478406.098139:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789478406.098166:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf800/0x8ebaae74e8215e13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.098173:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf800/0x8ebaae74e8215e13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.098182:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf800/0x8ebaae74e8215e13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478406.098200:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964404992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789478406.098235:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478406.098338:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34f72840 going to sleep for 11 seconds 00000100:00100000:3.0:1789478406.098384:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964404992 00000100:00100000:3.0:1789478406.098389:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964404992 00000100:00100000:3.0:1789478406.098431:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789478406.098441:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+19:6514:x1876403964404992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789478406.098459:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478406.098471:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc00031000/0x8ebaae74e8215e1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215e13 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.098490:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc00031000/0x8ebaae74e8215e1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215e13 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.098500:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc00031000/0x8ebaae74e8215e1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215e13 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.098507:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc00031000, rc 0) 00000100:00100000:3.0:1789478406.098544:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+20:6514:x1876403964404992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478406.098550:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789478406.098582:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964404992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789478406.098621:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf800/0x8ebaae74e8215e13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.098630:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf800/0x8ebaae74e8215e13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215e1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478406.098679:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964405120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789478406.098702:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478406.098717:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0355a900 going to sleep for 11 seconds 00000100:00100000:3.0:1789478406.098728:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964405120 00000100:00100000:3.0:1789478406.098732:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964405120 00000100:00100000:3.0:1789478406.098827:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789478406.098835:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+20:6514:x1876403964405120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789478406.098956:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+20:6514:x1876403964405120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478406.098963:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789478406.098990:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964405120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789478406.099017:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964405248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789478406.099051:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478406.099065:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0355a900 going to sleep for 11 seconds 00000100:00100000:3.0:1789478406.099075:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964405248 00000100:00100000:3.0:1789478406.099078:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964405248 00000100:00100000:3.0:1789478406.099094:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789478406.099100:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10002850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+20:6514:x1876403964405248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789478406.099168:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10002850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+20:6514:x1876403964405248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478406.099174:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789478406.099207:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964405248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789478406.103484:0:10353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10353:1876403964405376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789478406.103556:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478406.103638:0:10353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34de1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789478406.103721:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964405376 00000100:00100000:3.0:1789478406.103727:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964405376 00000100:00100000:3.0:1789478406.103783:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789478406.103794:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10001050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+20:10353:x1876403964405376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789478406.103925:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10001050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+20:10353:x1876403964405376:12345-0@lo:502:llog_process_th.0 Request processed in 133us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478406.103932:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789478406.104070:0:10353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10353:1876403964405376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789478406.104114:0:10353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10353:1876403964405504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789478406.104148:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478406.104181:0:10353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34f72b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789478406.104225:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964405504 00000100:00100000:0.0:1789478406.104229:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964405504 00000100:00100000:0.0:1789478406.104269:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789478406.104277:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+20:10353:x1876403964405504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789478406.104336:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+20:10353:x1876403964405504:12345-0@lo:502:llog_process_th.0 Request processed in 60us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478406.104342:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789478406.104463:0:10353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10353:1876403964405504:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789478406.104481:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789478406.104674:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789478406.104692:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789478406.104700:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf800/0x8ebaae74e8215e13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478406.104710:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf800/0x8ebaae74e8215e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478406.104719:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789478406.104721:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1789478406.104724:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789478406.104816:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66200/0x8ebaae74e8215e21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478406.104824:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66200/0x8ebaae74e8215e21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478406.104832:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66200/0x8ebaae74e8215e21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478406.104845:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964405632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789478406.104868:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478406.104908:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34de1780 going to sleep for 11 seconds 00000100:00100000:3.0:1789478406.104941:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964405632 00000100:00100000:3.0:1789478406.104945:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964405632 00000100:00100000:3.0:1789478406.104996:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789478406.105008:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+20:6514:x1876403964405632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789478406.105016:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478406.105034:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebb035fda00/0x8ebaae74e8215e28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215e21 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.105054:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebb035fda00/0x8ebaae74e8215e28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215e21 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.105063:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebb035fda00/0x8ebaae74e8215e28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215e21 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.105069:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fda00, rc 0) 00000100:00100000:3.0:1789478406.105110:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964405632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478406.105116:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789478406.105162:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964405632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789478406.105173:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66200/0x8ebaae74e8215e21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e28 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478406.105182:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66200/0x8ebaae74e8215e21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215e28 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478406.105219:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964405760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789478406.105239:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478406.109451:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34de1780 going to sleep for 11 seconds 00000100:00100000:1.0:1789478406.110407:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964405760 00000100:00100000:1.0:1789478406.110417:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964405760 00000100:00100000:1.0:1789478406.110463:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789478406.110472:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964405760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478406.110632:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964405760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (5390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478406.110640:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789478406.111289:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964405760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789478406.111335:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964405888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789478406.111382:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478406.111414:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34de1780 going to sleep for 11 seconds 00000100:00100000:1.0:1789478406.111515:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964405888 00000100:00100000:1.0:1789478406.111520:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964405888 00000100:00100000:1.0:1789478406.111560:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789478406.111568:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964405888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789478406.111689:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964405888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478406.111696:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789478406.111846:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964405888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789478406.112172:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10356:1876403964406016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789478406.112209:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478406.112241:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40fdb480 going to sleep for 11 seconds 00000100:00100000:0.0:1789478406.112351:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964406016 00000100:00100000:0.0:1789478406.112356:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964406016 00000100:00100000:0.0:1789478406.112389:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789478406.112396:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+21:10356:x1876403964406016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789478406.112485:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+21:10356:x1876403964406016:12345-0@lo:502:llog_process_th.0 Request processed in 89us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478406.112492:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789478406.112583:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10356:1876403964406016:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789478406.112635:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789478406.112644:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478406.112647:0:10356:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789478406.112653:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789478406.112672:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10356:1876403964406144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789478406.112704:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478406.112721:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40fdb480 going to sleep for 11 seconds 00000100:00100000:0.0:1789478406.112871:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964406144 00000100:00100000:0.0:1789478406.112875:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964406144 00000100:00100000:0.0:1789478406.112919:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789478406.112926:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10000850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+21:10356:x1876403964406144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789478406.113038:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10000850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+21:10356:x1876403964406144:12345-0@lo:502:llog_process_th.0 Request processed in 112us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478406.113044:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789478406.116417:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10356:1876403964406144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789478406.122833:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789478406.122843:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478406.122846:0:10356:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789478406.122851:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1789478406.122923:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1789478406.122945:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789478406.122956:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66200/0x8ebaae74e8215e21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e28 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478406.122968:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66200/0x8ebaae74e8215e21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e28 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478406.122978:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789478406.122980:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ebc0501d800 from 48 10000000:01000000:0.0:1789478406.122983:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789478406.123013:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66400/0x8ebaae74e8215e2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478406.123021:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66400/0x8ebaae74e8215e2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478406.123032:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66400/0x8ebaae74e8215e2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478406.123055:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964406272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789478406.123112:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478406.123928:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34de1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789478406.123972:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964406272 00000100:00100000:1.0:1789478406.123980:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964406272 00000100:00100000:1.0:1789478406.124117:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789478406.124127:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964406272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789478406.124141:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478406.124156:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40fcee00/0x8ebaae74e8215e36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215e2f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.124184:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40fcee00/0x8ebaae74e8215e36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215e2f expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.124206:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40fcee00/0x8ebaae74e8215e36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215e2f expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.124231:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcee00, rc 0) 00000100:00100000:1.0:1789478406.124287:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964406272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478406.124294:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789478406.124342:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964406272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789478406.124362:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66400/0x8ebaae74e8215e2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e36 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.124372:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66400/0x8ebaae74e8215e2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215e36 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478406.124433:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964406400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789478406.124463:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478406.124491:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40fdb480 going to sleep for 11 seconds 00000100:00100000:1.0:1789478406.124683:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964406400 00000100:00100000:1.0:1789478406.124687:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964406400 00000100:00100000:1.0:1789478406.124765:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789478406.124774:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964406400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478406.124903:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964406400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478406.124911:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789478406.124922:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964406400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789478406.124964:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964406528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789478406.125004:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478406.125339:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964406528 00000100:00100000:2.0:1789478406.125344:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964406528 00000100:00100000:0.0:1789478406.125344:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34de1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789478406.125377:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789478406.125387:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964406528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789478406.125480:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964406528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478406.125488:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789478406.125497:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964406528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789478406.125770:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10357:1876403964406656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789478406.125805:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478406.125834:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34de1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789478406.125850:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964406656 00000100:00100000:2.0:1789478406.125856:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964406656 00000100:00100000:2.0:1789478406.125896:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789478406.125903:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+22:10357:x1876403964406656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789478406.125991:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+22:10357:x1876403964406656:12345-0@lo:502:llog_process_th.0 Request processed in 87us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478406.125998:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789478406.126083:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10357:1876403964406656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789478406.126122:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10357:1876403964406784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789478406.126154:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478406.126174:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34de1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789478406.126310:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964406784 00000100:00100000:2.0:1789478406.126314:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964406784 00000100:00100000:2.0:1789478406.126343:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789478406.126350:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+22:10357:x1876403964406784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789478406.126416:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+22:10357:x1876403964406784:12345-0@lo:502:llog_process_th.0 Request processed in 67us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478406.126423:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789478406.126495:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10357:1876403964406784:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789478406.126527:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789478406.126755:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789478406.126774:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789478406.126783:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66400/0x8ebaae74e8215e2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e36 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.126793:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66400/0x8ebaae74e8215e2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e36 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478406.126802:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789478406.126804:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1789478406.126807:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789478406.126968:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8215e3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.126977:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8215e3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.126985:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8215e3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478406.127000:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964406912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789478406.127041:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478406.127073:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40fdb480 going to sleep for 11 seconds 00000100:00100000:0.0:1789478406.127298:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964406912 00000100:00100000:0.0:1789478406.127303:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964406912 00000100:00100000:0.0:1789478406.127341:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789478406.127348:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964406912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789478406.127357:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478406.127368:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc35b66000/0x8ebaae74e8215e44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215e3d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478406.127387:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc35b66000/0x8ebaae74e8215e44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215e3d expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478406.127409:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc35b66000/0x8ebaae74e8215e44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215e3d expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478406.127417:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b66000, rc 0) 00000100:00100000:0.0:1789478406.127461:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964406912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478406.127467:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789478406.129149:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964406912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789478406.129171:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8215e3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e44 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.129183:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8215e3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215e44 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478406.129328:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964407040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789478406.129375:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478406.129415:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0355a300 going to sleep for 11 seconds 00000100:00100000:2.0:1789478406.129462:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964407040 00000100:00100000:2.0:1789478406.129468:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964407040 00000100:00100000:2.0:1789478406.129526:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789478406.129719:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964407040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789478406.129830:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964407040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478406.129837:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789478406.129873:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964407040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789478406.129914:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964407168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789478406.129949:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478406.129963:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40fdb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478406.129974:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964407168 00000100:00100000:2.0:1789478406.129977:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964407168 00000100:00100000:2.0:1789478406.129993:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789478406.129999:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964407168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789478406.130124:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964407168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478406.130131:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789478406.130167:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964407168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789478406.130955:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10359:1876403964407296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789478406.130994:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478406.131102:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964407296 00000100:00100000:2.0:1789478406.131107:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964407296 00000100:00100000:2.0:1789478406.131140:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789478406.131148:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+23:10359:x1876403964407296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789478406.131349:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+23:10359:x1876403964407296:12345-0@lo:502:llog_process_th.0 Request processed in 201us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478406.131356:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789478406.131419:0:10359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0355a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789478406.131433:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10359:1876403964407296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789478406.131456:0:10359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789478406.131464:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478406.131467:0:10359:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789478406.131474:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789478406.131494:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10359:1876403964407424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789478406.131756:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478406.131822:0:10359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0355a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789478406.131853:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964407424 00000100:00100000:2.0:1789478406.131862:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964407424 00000100:00100000:2.0:1789478406.131931:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789478406.131939:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+23:10359:x1876403964407424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789478406.132026:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+23:10359:x1876403964407424:12345-0@lo:502:llog_process_th.0 Request processed in 78us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478406.132033:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789478406.132093:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10359:1876403964407424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789478406.132110:0:10359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789478406.132115:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478406.132116:0:10359:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789478406.132120:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1789478406.132370:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1789478406.132392:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789478406.132401:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8215e3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e44 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.132410:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8215e3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e44 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478406.132419:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789478406.132422:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ebc08d93370 from 1 10000000:01000000:2.0:1789478406.132424:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789478406.132448:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77000/0x8ebaae74e8215e4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.132456:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77000/0x8ebaae74e8215e4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.132465:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77000/0x8ebaae74e8215e4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478406.132480:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964407552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789478406.132750:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478406.132810:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40fdb900 going to sleep for 11 seconds 00000100:00100000:3.0:1789478406.132850:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964407552 00000100:00100000:3.0:1789478406.132855:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964407552 00000100:00100000:3.0:1789478406.132928:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789478406.132935:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964407552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789478406.132944:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478406.132956:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebb035fcc00/0x8ebaae74e8215e52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215e4b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.132975:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebb035fcc00/0x8ebaae74e8215e52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215e4b expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.132984:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebb035fcc00/0x8ebaae74e8215e52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215e4b expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.132992:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fcc00, rc 0) 00000100:00100000:3.0:1789478406.133134:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:6514:x1876403964407552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478406.133141:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789478406.133206:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964407552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789478406.133282:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77000/0x8ebaae74e8215e4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e52 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.133291:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77000/0x8ebaae74e8215e4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215e52 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478406.133338:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964407680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789478406.133364:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478406.133378:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40fdb900 going to sleep for 11 seconds 00000100:00100000:2.0:1789478406.133390:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964407680 00000100:00100000:2.0:1789478406.133393:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964407680 00000100:00100000:2.0:1789478406.133424:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789478406.133431:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:6514:x1876403964407680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789478406.133488:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:6514:x1876403964407680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 57us (123us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789478406.133495:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789478406.133531:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964407680:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789478406.133749:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789478406.133755:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77000/0x8ebaae74e8215e4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e52 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.133763:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77000/0x8ebaae74e8215e4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e52 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789478406.609154:0:10390:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce64636d0 20000000:00000080:1.0:1789478406.609246:0:10390:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ebb03650400 uarg=0000000000000000 20000000:01000000:1.0:1789478406.609291:0:10390:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789478406.609296:0:10390:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789478406.609301:0:10390:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789478406.610729:0:10391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789478406.612104:0:10390:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789478406.616827:0:10390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789478406.616858:0:10390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789478406.616871:0:10390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789478406.616898:0:10390:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789478406.616915:0:10390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ebc40fcfa00/0x8ebaae74e8215e59 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.616932:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc029dfc00/0x8ebaae74e8215ae7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215ae0 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.616945:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc029de200/0x8ebaae74e8215b03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215afc expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.616952:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc00030a00/0x8ebaae74e8215b57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215b50 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.616959:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc34f76000/0x8ebaae74e8215c7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215c76 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.616967:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc40fce400/0x8ebaae74e8215d95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7188 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.616974:0:10390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ebc40fcfa00/0x8ebaae74e8215e59 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.617008:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc40fce400/0x8ebaae74e8215d95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7188 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.617021:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ebc40fce400/0x8ebaae74e8215d95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7188 expref: 9 pid: 6511 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478406.617034:0:10390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1876403964407808:192.168.206.11@tcp:104: 00010000:00010000:1.0:1789478406.617136:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc34f76000/0x8ebaae74e8215c7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215c76 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.617144:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc34f76000/0x8ebaae74e8215c7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215c76 expref: 23 pid: 6510 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478406.617154:0:10390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1876403964407936:0@lo:104: 00000100:00100000:1.0:1789478406.617200:0:10390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789478406.617867:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc00030a00/0x8ebaae74e8215b57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215b50 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.617888:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc00030a00/0x8ebaae74e8215b57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215b50 expref: 23 pid: 6511 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478406.617898:0:10390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1876403964408064:0@lo:104: 00000100:00100000:1.0:1789478406.617924:0:10390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789478406.618359:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc029de200/0x8ebaae74e8215b03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215afc expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.618377:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc029de200/0x8ebaae74e8215b03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215afc expref: 23 pid: 6511 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478406.618387:0:10390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1876403964408192:0@lo:104: 00010000:00010000:1.0:1789478406.618414:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc029dfc00/0x8ebaae74e8215ae7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215ae0 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.618422:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc029dfc00/0x8ebaae74e8215ae7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215ae0 expref: 23 pid: 6510 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478406.618430:0:10390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1876403964408320:0@lo:104: 00000100:00100000:1.0:1789478406.618445:0:10390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34f72540 going to sleep for 11 seconds 00000100:00100000:2.0:1789478406.618849:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789478406.618870:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478406.618904:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478406.618913:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964407936 00000100:00100000:2.0:1789478406.618919:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964407936 00000100:00100000:2.0:1789478406.618955:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964408064 00000100:00100000:2.0:1789478406.618958:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964408064 00000100:00100000:2.0:1789478406.618979:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964408192 00000100:00100000:2.0:1789478406.618982:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964408192 00000100:00100000:2.0:1789478406.618992:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964408320 00000100:00100000:2.0:1789478406.618993:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964408320 00000100:00100000:2.0:1789478406.619005:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789478406.619012:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+6:10390:x1876403964407936:12345-0@lo:104: 00010000:00010000:2.0:1789478406.619025:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc42176000/0x8ebaae74e8215c76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215c7d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.619083:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789478406.619088:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+6:10390:x1876403964407936:12345-0@lo:104: Request processed in 77us (1889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478406.619095:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789478406.619111:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789478406.619116:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03652c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+5:10390:x1876403964408064:12345-0@lo:104: 00010000:00010000:2.0:1789478406.619124:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc421ede00/0x8ebaae74e8215b50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215b57 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.619156:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789478406.619161:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03652c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+5:10390:x1876403964408064:12345-0@lo:104: Request processed in 45us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478406.619166:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789478406.619191:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789478406.619197:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03598700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+4:10390:x1876403964408192:12345-0@lo:104: 00010000:00010000:2.0:1789478406.619213:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed600/0x8ebaae74e8215afc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215b03 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.619246:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789478406.619252:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03598700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+4:10390:x1876403964408192:12345-0@lo:104: Request processed in 54us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478406.619257:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789478406.619270:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789478406.619276:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03599180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+3:10390:x1876403964408320:12345-0@lo:104: 00010000:00010000:2.0:1789478406.619282:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc00031200/0x8ebaae74e8215ae0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215ae7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.619307:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789478406.619312:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03599180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+3:10390:x1876403964408320:12345-0@lo:104: Request processed in 37us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478406.619317:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1789478406.619333:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789478406.619338:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc42176000/0x8ebaae74e8215c76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215c7d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.619344:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc42176000 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:2.0:1789478406.619348:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc42176000/0x8ebaae74e8215c76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215c7d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.619356:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc42176000/0x8ebaae74e8215c76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215c7d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789478406.619364:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc42176000/0x8ebaae74e8215c76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215c7d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.619750:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789478406.619756:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc421ede00/0x8ebaae74e8215b50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215b57 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.619762:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc421ede00 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:1.0:1789478406.619765:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc421ede00/0x8ebaae74e8215b50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215b57 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.619782:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc421ede00/0x8ebaae74e8215b50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215b57 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478406.619788:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc421ede00/0x8ebaae74e8215b50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215b57 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478406.619798:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789478406.619838:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc421ede00/0x8ebaae74e8215b50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215b57 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.619844:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789478406.619866:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc421ede00/0x8ebaae74e8215b50 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215b57 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.619884:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc421ede00/0x8ebaae74e8215b50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215b57 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.619899:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789478406.619902:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed600/0x8ebaae74e8215afc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215b03 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.619908:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc421ed600 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:1.0:1789478406.619911:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed600/0x8ebaae74e8215afc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215b03 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.619918:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed600/0x8ebaae74e8215afc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215b03 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478406.619924:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed600/0x8ebaae74e8215afc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215b03 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478406.619941:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789478406.619962:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed600/0x8ebaae74e8215afc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215b03 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.619982:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789478406.620004:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed600/0x8ebaae74e8215afc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215b03 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.620011:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed600/0x8ebaae74e8215afc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215b03 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.620021:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789478406.620030:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc00031200/0x8ebaae74e8215ae0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215ae7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.620036:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc00031200 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:1.0:1789478406.620039:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc00031200/0x8ebaae74e8215ae0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215ae7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.620045:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc00031200/0x8ebaae74e8215ae0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215ae7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478406.620055:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc00031200/0x8ebaae74e8215ae0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215ae7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478406.620061:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789478406.620079:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc00031200/0x8ebaae74e8215ae0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215ae7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.620085:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789478406.620103:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc00031200/0x8ebaae74e8215ae0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215ae7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.620110:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc00031200/0x8ebaae74e8215ae0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215ae7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478406.620125:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478406.620127:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478406.620129:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478406.620187:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964408448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789478406.620218:0:10390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1876403964407936:0@lo:104: 00000100:00100000:1.0:1789478406.620226:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478406.620238:0:10390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1876403964408064:0@lo:104: 00000100:00100000:3.0:1789478406.620250:0:10390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1876403964408192:0@lo:104: 00000100:00100000:3.0:1789478406.620257:0:10390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1876403964408320:0@lo:104: 00000100:00100000:1.0:1789478406.620298:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964408704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789478406.620338:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478406.620366:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789478406.620372:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964408576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789478406.620392:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1789478406.620686:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789478406.620704:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc42176000/0x8ebaae74e8215c76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215c7d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.620711:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789478406.620725:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc42176000/0x8ebaae74e8215c76 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215c7d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.620732:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc42176000/0x8ebaae74e8215c76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215c7d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.620753:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478406.620755:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478406.620757:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478406.620775:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964408832:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789478406.620778:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478406.620818:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478406.620861:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964408448 00000100:00100000:2.0:1789478406.620866:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964408448 00010000:00010000:2.0:1789478406.620902:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc00030a00/0x8ebaae74e8215b57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215b50 expref: 24 pid: 6511 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478406.620926:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964408704 00000100:00100000:2.0:1789478406.620929:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964408704 00000100:00100000:3.0:1789478406.620934:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964408576 00000100:00100000:3.0:1789478406.620941:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964408576 00010000:00010000:2.0:1789478406.620944:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc029dfc00/0x8ebaae74e8215ae7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215ae0 expref: 25 pid: 6510 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.620963:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc029de200/0x8ebaae74e8215b03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215afc expref: 26 pid: 6511 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478406.620963:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964408832 00000100:00100000:2.0:1789478406.620979:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964408832 00000100:00100000:3.0:1789478406.620986:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789478406.620996:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+27:3648:x1876403964408448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789478406.621001:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc34f76000/0x8ebaae74e8215c7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215c76 expref: 27 pid: 6510 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.621008:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478406.621016:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc00030a00/0x8ebaae74e8215b57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215b50 expref: 27 pid: 6511 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.621036:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc00030a00/0x8ebaae74e8215b57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215b50 expref: 27 pid: 6511 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.621052:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc00030a00/0x8ebaae74e8215b57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215b50 expref: 27 pid: 6511 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478406.621053:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1789478406.621070:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478406.621070:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+26:3646:x1876403964408704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789478406.621086:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478406.621092:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc029dfc00/0x8ebaae74e8215ae7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215ae0 expref: 26 pid: 6510 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478406.621107:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+26:3648:x1876403964408448:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (881us total) trans 0 rc 0/0 00010000:00010000:2.0:1789478406.621108:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc029dfc00/0x8ebaae74e8215ae7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215ae0 expref: 26 pid: 6510 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.621120:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc029dfc00/0x8ebaae74e8215ae7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215ae0 expref: 26 pid: 6510 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478406.621125:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:2.0:1789478406.621135:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478406.621146:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789478406.621155:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3646:x1876403964408576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789478406.621164:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478406.621170:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc029de200/0x8ebaae74e8215b03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215afc expref: 24 pid: 6511 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478406.621172:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3646:x1876403964408704:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478406.621187:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789478406.621201:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789478406.621207:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08343450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+23:3647:x1876403964408832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789478406.621215:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478406.621219:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc34f76000/0x8ebaae74e8215c7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215c76 expref: 23 pid: 6510 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478406.621361:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964408448:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789478406.622636:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc029de200/0x8ebaae74e8215b03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215afc expref: 24 pid: 6511 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478406.623061:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:0.0:1789478406.623630:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478406.623653:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1789478406.623662:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1789478406.623709:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964408704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789478406.623805:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945477888 00000100:00100000:0.0:1789478406.623811:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945477888 00010000:00010000:0.0:1789478406.623838:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc40fce400/0x8ebaae74e8215d95 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7188 expref: 10 pid: 6511 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478406.623862:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1789478406.623871:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 39 00010000:00010000:2.0:1789478406.624178:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc34f76000/0x8ebaae74e8215c7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215c76 expref: 23 pid: 6510 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.624198:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc34f76000/0x8ebaae74e8215c7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215c76 expref: 23 pid: 6510 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.624225:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478406.624275:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08343450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+22:3647:x1876403964408832:12345-0@lo:103:ldlm_bl.0 Request processed in 3067us (3455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478406.624304:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:2396:x1876403945477888:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478406.624316:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478406.624322:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc40fce400/0x8ebaae74e8215d95 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7188 expref: 10 pid: 6511 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478406.624332:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc40fce400/0x8ebaae74e8215d95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7188 expref: 10 pid: 6511 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478406.624353:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478406.624400:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:2396:x1876403945477888:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 99us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478406.625499:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789478406.625550:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964408832:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789478406.625707:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc029de200/0x8ebaae74e8215b03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215afc expref: 21 pid: 6511 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.625727:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ebc40fcfa00/0x8ebaae74e8215e59 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.625736:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40fcfa00/0x8ebaae74e8215e59 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.625750:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc40fce400/0x8ebaae74e8215d95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7188 expref: 10 pid: 6511 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.625753:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc40fcfa00/0x8ebaae74e8215e59 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.625769:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc40fcfa00/0x8ebaae74e8215e59 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478406.625772:0:10390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1876403964407808:192.168.206.11@tcp:104: 00010000:00010000:3.0:1789478406.625783:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ebc40fcfa00/0x8ebaae74e8215e59 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.625791:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ebc40fcfa00/0x8ebaae74e8215e59 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.625804:0:10390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ebc40fcfa00/0x8ebaae74e8215e59 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.625816:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfa00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478406.625820:0:10390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff8ebc40fcfa00/0x8ebaae74e8215e59 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.625822:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ebc40fcfa00/0x8ebaae74e8215e59 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478406.625838:0:10390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ebc40fcfa00/0x8ebaae74e8215e59 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.625841:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ebc40fcfa00/0x8ebaae74e8215e59 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.625854:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ebc40fcfa00/0x8ebaae74e8215e59 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.625862:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc40fcfa00/0x8ebaae74e8215e59 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478406.625897:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478406.626008:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+20:3646:x1876403964408576:12345-0@lo:103:ldlm_bl.0 Request processed in 4853us (5613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478406.626016:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789478406.626088:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964408576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789478406.627066:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 39 00010000:00010000:1.0:1789478406.692916:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478407.491079:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478407.491254:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945478016 00000100:00100000:0.0:1789478407.491264:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945478016 00000100:00100000:0.0:1789478407.491320:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 246 00000100:00100000:0.0:1789478407.491331:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+9:6164:x1876403945478016:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789478407.491346:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478407.491363:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc35b67400/0x8ebaae74e8215e60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b71ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478407.491402:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc35b67400/0x8ebaae74e8215e60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b71ce expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478407.491414:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc35b67400/0x8ebaae74e8215e60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b71ce expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478407.491424:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b67400, rc 0) 00000100:00100000:0.0:1789478407.491890:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:6164:x1876403945478016:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 Request processed in 558us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478407.491897:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 246 00000100:00100000:0.0:1789478407.508061:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478407.508622:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945478144 00000100:00100000:2.0:1789478407.508631:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945478144 00000100:00100000:2.0:1789478407.508679:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 247 00000100:00100000:2.0:1789478407.508689:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:6164:x1876403945478144:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789478407.508843:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:6164:x1876403945478144:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 Request processed in 154us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478407.508851:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 247 00000100:00100000:0.0:1789478407.513935:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478407.514024:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945478272 00000100:00100000:3.0:1789478407.514034:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945478272 00000100:00100000:3.0:1789478407.514092:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 248 00000100:00100000:3.0:1789478407.514101:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:6164:x1876403945478272:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789478407.514273:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:6164:x1876403945478272:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 Request processed in 172us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478407.514281:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 248 00000100:00100000:1.0:1789478407.524018:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478407.524635:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945478400 00000100:00100000:3.0:1789478407.524645:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945478400 00000100:00100000:3.0:1789478407.524711:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 249 00000100:00100000:3.0:1789478407.524721:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:6695:x1876403945478400:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789478407.524867:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:6695:x1876403945478400:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 146us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478407.524885:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 249 00000100:00100000:0.0:1789478407.529308:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478407.529572:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945478528 00000100:00100000:3.0:1789478407.529582:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945478528 00000100:00100000:3.0:1789478407.529665:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 250 00000100:00100000:3.0:1789478407.529674:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:6695:x1876403945478528:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789478407.529988:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:6695:x1876403945478528:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 314us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478407.529996:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 250 10000000:01000000:3.0:1789478407.653883:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789478407.653890:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebc3f6c1800 from 4 10000000:01000000:3.0:1789478407.653895:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789478407.653935:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e8215e67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478407.653947:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e8215e67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478407.653958:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e8215e67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478407.653981:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964408960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789478407.654041:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478407.654099:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40ecb600 going to sleep for 11 seconds 00000100:00100000:2.0:1789478407.656644:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964408960 00000100:00100000:2.0:1789478407.656662:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964408960 00000100:00100000:2.0:1789478407.656714:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789478407.656724:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+20:6514:x1876403964408960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789478407.656739:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478407.656755:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc34f76400/0x8ebaae74e8215e6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215e67 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478407.656782:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc34f76400/0x8ebaae74e8215e6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215e67 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478407.656793:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc34f76400/0x8ebaae74e8215e6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215e67 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478407.656802:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76400, rc 0) 00000100:00100000:2.0:1789478407.656864:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964408960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (2823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478407.656884:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789478407.657036:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964408960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789478407.657054:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e8215e67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e6e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478407.657064:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e8215e67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215e6e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478407.657128:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964409088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789478407.657160:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478407.657200:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0273d840 going to sleep for 11 seconds 00000100:00100000:1.0:1789478407.657705:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964409088 00000100:00100000:1.0:1789478407.657711:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964409088 00000100:00100000:1.0:1789478407.657990:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789478407.658000:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964409088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478407.658130:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964409088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478407.658137:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789478407.658271:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964409088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789478407.658308:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964409216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789478407.658345:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478407.658444:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0273d840 going to sleep for 11 seconds 00000100:00100000:0.0:1789478407.658997:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964409216 00000100:00100000:0.0:1789478407.659009:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964409216 00000100:00100000:0.0:1789478407.659051:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789478407.659059:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964409216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789478407.659179:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964409216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478407.659185:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789478407.659229:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964409216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789478407.660016:0:10435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10435:1876403964409344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789478407.660063:0:10435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478407.660195:0:10435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40dfc900 going to sleep for 11 seconds 00000100:00100000:2.0:1789478407.664910:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964409344 00000100:00100000:2.0:1789478407.664924:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964409344 00000100:00100000:0.0:1789478407.668686:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789478407.668699:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc272ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+21:10435:x1876403964409344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789478407.668996:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc272ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+21:10435:x1876403964409344:12345-0@lo:502:llog_process_th.0 Request processed in 299us (8931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478407.669005:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789478407.670914:0:10435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10435:1876403964409344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789478407.670954:0:10435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789478407.670963:0:10435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478407.670966:0:10435:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789478407.670972:0:10435:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ebc3f6c1800 00000020:00000080:0.0:1789478407.670975:0:10435:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789478407.675335:0:10435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10435:1876403964409472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789478407.676228:0:10435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478407.676269:0:10435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40e860c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478407.676834:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964409472 00000100:00100000:2.0:1789478407.676842:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964409472 00000100:00100000:2.0:1789478407.676902:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789478407.676913:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc272aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+21:10435:x1876403964409472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789478407.677042:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc272aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+21:10435:x1876403964409472:12345-0@lo:502:llog_process_th.0 Request processed in 131us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478407.677048:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789478407.677936:0:10435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10435:1876403964409472:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789478407.677969:0:10435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789478407.677977:0:10435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478407.677979:0:10435:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789478407.677985:0:10435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789478407.682912:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789478407.682948:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789478407.682959:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e8215e67 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e6e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478407.682983:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e8215e67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e6e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478407.682993:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789478407.682995:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebc40e0d800 from 4 10000000:01000000:0.0:1789478407.682998:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789478407.683028:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66600/0x8ebaae74e8215e75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478407.683036:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66600/0x8ebaae74e8215e75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478407.683046:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66600/0x8ebaae74e8215e75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478407.683070:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964409600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789478407.683131:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478407.683182:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40dfc900 going to sleep for 11 seconds 00000100:00100000:1.0:1789478407.688919:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964409600 00000100:00100000:1.0:1789478407.688933:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964409600 00000100:00100000:1.0:1789478407.688997:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789478407.689007:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964409600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789478407.689024:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478407.689042:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40fcf600/0x8ebaae74e8215e7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215e75 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478407.689067:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40fcf600/0x8ebaae74e8215e7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215e75 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478407.689078:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40fcf600/0x8ebaae74e8215e7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215e75 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478407.689100:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcf600, rc 0) 00000100:00100000:1.0:1789478407.689164:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964409600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (6033us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478407.689171:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789478407.689219:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964409600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789478407.689242:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66600/0x8ebaae74e8215e75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478407.689259:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66600/0x8ebaae74e8215e75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215e7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478407.689347:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964409728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478407.690428:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478407.690482:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc1a16a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478407.690583:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964409728 00000100:00100000:3.0:1789478407.690620:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964409728 00000100:00100000:3.0:1789478407.690657:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789478407.690665:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964409728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789478407.690797:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964409728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478407.690804:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789478407.690843:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964409728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789478407.690890:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964409856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789478407.690931:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478407.690945:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40ecbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789478407.690956:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964409856 00000100:00100000:3.0:1789478407.690959:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964409856 00000100:00100000:3.0:1789478407.690978:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789478407.690984:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964409856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789478407.691056:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964409856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478407.691062:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789478407.691100:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964409856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789478407.691515:0:10440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10440:1876403964409984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789478407.691550:0:10440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478407.691580:0:10440:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40e86240 going to sleep for 11 seconds 00000100:00100000:3.0:1789478407.691723:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964409984 00000100:00100000:3.0:1789478407.691728:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964409984 00000100:00100000:3.0:1789478407.691769:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789478407.691776:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+22:10440:x1876403964409984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789478407.691848:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+22:10440:x1876403964409984:12345-0@lo:502:llog_process_th.0 Request processed in 73us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478407.691855:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789478407.691995:0:10440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10440:1876403964409984:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789478407.692017:0:10440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789478407.692026:0:10440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478407.692029:0:10440:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789478407.692035:0:10440:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ebc40e0d800 00000020:00000080:1.0:1789478407.692038:0:10440:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789478407.692111:0:10440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10440:1876403964410112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789478407.692145:0:10440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478407.692175:0:10440:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478407.692218:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964410112 00000100:00100000:3.0:1789478407.692223:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964410112 00000100:00100000:3.0:1789478407.692254:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789478407.692262:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+22:10440:x1876403964410112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789478407.692327:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+22:10440:x1876403964410112:12345-0@lo:502:llog_process_th.0 Request processed in 65us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478407.692334:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789478407.692401:0:10440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10440:1876403964410112:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789478407.692418:0:10440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789478407.692422:0:10440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478407.692423:0:10440:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789478407.692426:0:10440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789478407.692655:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789478407.692675:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789478407.692682:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66600/0x8ebaae74e8215e75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478407.692693:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66600/0x8ebaae74e8215e75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478407.692703:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789478407.692705:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebc34d64800 from 4 10000000:01000000:3.0:1789478407.692707:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789478407.692729:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e8215e83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478407.692737:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e8215e83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478407.692815:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e8215e83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478407.692829:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964410240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789478407.692854:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478407.693922:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40ecb840 going to sleep for 11 seconds 00000100:00100000:1.0:1789478407.701676:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964410240 00000100:00100000:1.0:1789478407.701690:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964410240 00000100:00100000:1.0:1789478407.701817:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789478407.701837:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964410240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789478407.701852:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478407.701879:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40fce600/0x8ebaae74e8215e8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215e83 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478407.701904:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40fce600/0x8ebaae74e8215e8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215e83 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478407.701916:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40fce600/0x8ebaae74e8215e8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215e83 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478407.701925:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fce600, rc 0) 00000100:00100000:1.0:1789478407.701993:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964410240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (9137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478407.702000:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789478407.702061:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964410240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789478407.702076:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e8215e83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e8a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478407.702085:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e8215e83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215e8a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478407.702148:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964410368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478407.702181:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478407.702206:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789478407.702217:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964410368 00000100:00100000:1.0:1789478407.702220:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964410368 00000100:00100000:1.0:1789478407.702241:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789478407.702254:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964410368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478407.702349:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964410368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478407.702355:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789478407.702384:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964410368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478407.702409:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964410496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789478407.702448:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478407.702461:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789478407.703890:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964410496 00000100:00100000:1.0:1789478407.703899:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964410496 00000100:00100000:1.0:1789478407.703936:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789478407.703945:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964410496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789478407.704058:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964410496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478407.704065:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789478407.704113:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964410496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789478407.704283:0:10443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10443:1876403964410624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789478407.704320:0:10443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478407.704341:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964410624 00000100:00100000:1.0:1789478407.704345:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964410624 00000100:00100000:1.0:1789478407.704378:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789478407.704385:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+23:10443:x1876403964410624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789478407.704449:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+23:10443:x1876403964410624:12345-0@lo:502:llog_process_th.0 Request processed in 64us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478407.704464:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789478407.704515:0:10443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478407.704527:0:10443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10443:1876403964410624:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789478407.704547:0:10443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789478407.704556:0:10443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478407.704558:0:10443:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789478407.704565:0:10443:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ebc34d64800 00000020:00000080:1.0:1789478407.704567:0:10443:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789478407.704648:0:10443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10443:1876403964410752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789478407.704681:0:10443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478407.704699:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964410752 00000100:00100000:1.0:1789478407.704702:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964410752 00000100:00100000:1.0:1789478407.704721:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789478407.704727:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+23:10443:x1876403964410752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789478407.706876:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+23:10443:x1876403964410752:12345-0@lo:502:llog_process_th.0 Request processed in 2008us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478407.706888:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789478407.706945:0:10443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478407.706965:0:10443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10443:1876403964410752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789478407.706991:0:10443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789478407.706999:0:10443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478407.707002:0:10443:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789478407.707007:0:10443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789478407.707663:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789478407.707688:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789478407.707698:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e8215e83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e8a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478407.710818:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e8215e83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e8a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478407.710841:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789478407.710844:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebc0501d800 from 4 10000000:01000000:3.0:1789478407.710846:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789478407.710890:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e8215e91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478407.710899:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e8215e91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478407.710910:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e8215e91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478407.710934:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964410880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789478407.710992:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478407.711032:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40ecbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789478407.711056:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964410880 00000100:00100000:3.0:1789478407.711061:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964410880 00000100:00100000:3.0:1789478407.711103:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789478407.711112:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964410880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789478407.711123:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478407.711135:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebb035fce00/0x8ebaae74e8215e98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215e91 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478407.711164:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebb035fce00/0x8ebaae74e8215e98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215e91 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478407.711174:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebb035fce00/0x8ebaae74e8215e98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215e91 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478407.711182:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fce00, rc 0) 00000100:00100000:3.0:1789478407.711217:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:6514:x1876403964410880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478407.711224:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789478407.711268:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964410880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789478407.711281:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e8215e91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e98 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478407.711290:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e8215e91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215e98 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478407.711341:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964411008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789478407.711365:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478407.711380:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40ecbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789478407.711392:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964411008 00000100:00100000:3.0:1789478407.711395:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964411008 00000100:00100000:3.0:1789478407.711417:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789478407.711422:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:6514:x1876403964411008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789478407.712672:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:6514:x1876403964411008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1241us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478407.712691:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789478407.713953:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964411008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478407.714004:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964411136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789478407.714070:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478407.714103:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02bf6000 going to sleep for 11 seconds 00000100:00100000:2.0:1789478407.715901:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964411136 00000100:00100000:2.0:1789478407.715912:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964411136 00000100:00100000:2.0:1789478407.715959:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789478407.715969:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:6514:x1876403964411136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789478407.716099:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:6514:x1876403964411136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (2029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478407.716106:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789478407.716163:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964411136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789478407.716322:0:10446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10446:1876403964411264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789478407.716362:0:10446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478407.716382:0:10446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0273d540 going to sleep for 11 seconds 00000100:00100000:3.0:1789478407.717921:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964411264 00000100:00100000:3.0:1789478407.717931:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964411264 00000100:00100000:3.0:1789478407.717977:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789478407.717984:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:10446:x1876403964411264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789478407.718107:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:10446:x1876403964411264:12345-0@lo:502:llog_process_th.0 Request processed in 122us (1744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478407.718115:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789478407.718441:0:10446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10446:1876403964411264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789478407.719570:0:10446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789478407.719616:0:10446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478407.719619:0:10446:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789478407.719628:0:10446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ebc0501d800 00000020:00000080:2.0:1789478407.719630:0:10446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789478407.719714:0:10446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10446:1876403964411392:0@lo:502:llog_process_th.0 00010000:00010000:3.0:1789478407.719851:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478407.720581:0:10446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478407.720635:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964411392 00000100:00100000:2.0:1789478407.720642:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964411392 00000100:00100000:2.0:1789478407.720686:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789478407.720695:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:10446:x1876403964411392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789478407.724283:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:10446:x1876403964411392:12345-0@lo:502:llog_process_th.0 Request processed in 3582us (3696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478407.724295:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789478407.724867:0:10446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0273d540 going to sleep for 11 seconds 00000100:00100000:2.0:1789478407.724901:0:10446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:10446:1876403964411392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789478407.724933:0:10446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789478407.724940:0:10446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478407.724942:0:10446:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789478407.724947:0:10446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789478407.725282:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789478407.725301:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789478407.725311:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e8215e91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e98 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478407.725322:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e8215e91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e98 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478407.914039:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964411520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789478407.914573:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478407.915438:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964411520 00000100:00100000:3.0:1789478407.915448:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964411520 00000100:00100000:3.0:1789478407.915641:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789478407.915653:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964411520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789478407.915879:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478407.915943:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964411520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 292us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478407.915951:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1789478407.915972:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789478407.916004:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc08887800 x1876403964411520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478407.916022:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964411520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789478408.326272:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478408.326360:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478408.326383:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478408.326420:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478408.326442:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478408.326529:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945478784 00000100:00100000:0.0:1789478408.326538:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945478784 00000100:00100000:0.0:1789478408.326622:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945478912 00000100:00100000:0.0:1789478408.326626:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945478912 00000100:00100000:0.0:1789478408.326649:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 56 00000100:00100000:0.0:1789478408.326658:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2398:x1876403945478784:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478408.326727:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2398:x1876403945478784:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 70us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478408.326736:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 56 00000100:00100000:0.0:1789478408.326753:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:0.0:1789478408.326774:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945478912:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478408.326798:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945478912:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 26us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478408.326804:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:3.0:1789478408.327059:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945479040 00000100:00100000:3.0:1789478408.327064:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945479040 00000100:00100000:3.0:1789478408.327107:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945479168 00000100:00100000:3.0:1789478408.327111:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945479168 00000100:00100000:3.0:1789478408.327133:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:3.0:1789478408.327142:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945479040:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478408.327177:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945479040:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 36us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478408.327183:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:3.0:1789478408.327195:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:3.0:1789478408.327202:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945479168:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478408.327223:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945479168:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 22us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478408.327229:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00080000:1.0:1789478408.327394:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789478408.327398:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789478408.327401:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789478408.327403:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789478408.327450:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945478656 00000100:00100000:2.0:1789478408.327456:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945478656 00000100:00100000:2.0:1789478408.327531:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 271 00000100:00100000:2.0:1789478408.327539:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:2398:x1876403945478656:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1789478408.327579:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:2398:x1876403945478656:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 42us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478408.327587:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 271 00000100:00100000:0.0:1789478408.423764:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964411648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789478408.423830:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478408.426456:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964411648 00000100:00100000:3.0:1789478408.426470:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964411648 00000100:00100000:3.0:1789478408.426541:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789478408.426553:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964411648:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789478408.426567:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789478408.426575:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478408.426671:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964411648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (2839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478408.426679:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1789478408.426842:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb036d4000 x1876403964411648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478408.426860:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964411648:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789478408.741730:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478409.772447:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478409.957548:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964411776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789478409.957647:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478409.957713:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964411776 00000100:00100000:2.0:1789478409.957720:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964411776 00000100:00100000:2.0:1789478409.957779:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789478409.957789:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0359a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964411776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789478409.957820:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789478409.957876:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0359a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964411776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478409.957884:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789478409.957929:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964411776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789478409.960298:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964411904:0@lo:400:kworker.0 00000100:00100000:2.0:1789478409.960355:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478409.960390:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964412416:0@lo:400:kworker.0 00000100:00100000:2.0:1789478409.960415:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478409.960434:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876403964412928:0@lo:400:kworker.0 00000100:00100000:2.0:1789478409.960452:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478409.960487:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789478409.960493:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964412032:0@lo:400:kworker.0 00000100:00100000:2.0:1789478409.960513:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478409.960541:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964412544:0@lo:400:kworker.0 00000100:00100000:2.0:1789478409.960563:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478409.960577:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964413056:0@lo:400:kworker.0 00000100:00100000:2.0:1789478409.960619:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478409.960644:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964411904 00000100:00100000:2.0:1789478409.960657:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964411904 00000100:00100000:2.0:1789478409.960700:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789478409.960709:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964411904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478409.960754:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964411904:12345-0@lo:400:kworker.0 Request processed in 46us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478409.960760:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789478409.960790:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964412416 00000100:00100000:2.0:1789478409.960794:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964412416 00000100:00100000:2.0:1789478409.960819:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964412928 00000100:00100000:2.0:1789478409.960822:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964412928 00000100:00100000:2.0:1789478409.960834:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964412032 00000100:00100000:2.0:1789478409.960836:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964412032 00000100:00100000:2.0:1789478409.960844:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964412544 00000100:00100000:2.0:1789478409.960846:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964412544 00000100:00100000:2.0:1789478409.960867:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964413056 00000100:00100000:2.0:1789478409.960870:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964413056 00000100:00100000:2.0:1789478409.960886:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789478409.960892:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0359bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964412416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478409.960923:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0359bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964412416:12345-0@lo:400:kworker.0 Request processed in 32us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478409.960929:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789478409.960939:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789478409.960946:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876403964412928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478409.960969:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876403964412928:12345-0@lo:400:kworker.0 Request processed in 24us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478409.960975:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789478409.960984:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789478409.960989:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964412032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478409.961022:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964412032:12345-0@lo:400:kworker.0 Request processed in 33us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478409.961028:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789478409.961277:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789478409.961284:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964412544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478409.961315:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964412544:12345-0@lo:400:kworker.0 Request processed in 32us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478409.961321:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789478409.961330:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789478409.961336:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964413056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478409.961359:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964413056:12345-0@lo:400:kworker.0 Request processed in 24us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478409.961365:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1789478409.961392:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789478409.961395:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789478409.961405:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964412160:0@lo:400:kworker.0 00000100:00100000:2.0:1789478409.961434:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478409.961465:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964412672:0@lo:400:kworker.0 00000100:00100000:2.0:1789478409.961491:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478409.961509:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964413184:0@lo:400:kworker.0 00000100:00100000:3.0:1789478409.961794:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876403964412288:0@lo:400:kworker.0 00000100:00100000:3.0:1789478409.961823:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478409.961842:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964412800:0@lo:400:kworker.0 00000100:00100000:3.0:1789478409.961875:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478409.961900:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964413312:0@lo:400:kworker.0 00000100:00100000:3.0:1789478409.961922:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478409.961950:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964412672 00000100:00100000:3.0:1789478409.961954:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964412672 00000100:00100000:3.0:1789478409.961979:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964412800 00000100:00100000:3.0:1789478409.961983:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964412800 00000100:00100000:3.0:1789478409.961999:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964413312 00000100:00100000:3.0:1789478409.962001:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964413312 00000100:00100000:3.0:1789478409.962013:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789478409.962019:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964412672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478409.962062:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964412672:12345-0@lo:400:kworker.0 Request processed in 43us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478409.962069:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789478409.962081:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789478409.962086:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964412800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478409.962114:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964412800:12345-0@lo:400:kworker.0 Request processed in 28us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478409.962120:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789478409.962131:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789478409.962136:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964413312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478409.962162:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964413312:12345-0@lo:400:kworker.0 Request processed in 26us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478409.962167:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789478409.962206:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964412032:0@lo:400:kworker.0 00010000:00080000:3.0:1789478409.962220:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03598000 x1876403964412544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478409.962231:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964412544:0@lo:400:kworker.0 00010000:00080000:3.0:1789478409.962249:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03599c00 x1876403964413056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478409.962258:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964413056:0@lo:400:kworker.0 00000100:00100000:3.0:1789478409.962267:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964411904:0@lo:400:kworker.0 00000100:00100000:3.0:1789478409.962276:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964412416:0@lo:400:kworker.0 00000100:00100000:3.0:1789478409.962285:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876403964412928:0@lo:400:kworker.0 00010000:00080000:3.0:1789478409.962318:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb0359b480 x1876403964412800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478409.962326:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964412800:0@lo:400:kworker.0 00010000:00080000:3.0:1789478409.962334:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb0359aa00 x1876403964413312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478409.962342:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964413312:0@lo:400:kworker.0 00000100:00100000:2.0:1789478409.963152:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789478409.963188:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb0359b800 x1876403964412672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478409.963198:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964412672:0@lo:400:kworker.0 00000100:00100000:2.0:1789478409.963235:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964412160 00000100:00100000:2.0:1789478409.963241:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964412160 00000100:00100000:2.0:1789478409.963275:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789478409.963282:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964412160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478409.963320:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964412160:12345-0@lo:400:kworker.0 Request processed in 38us (1886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478409.963326:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789478409.963344:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964413184 00000100:00100000:2.0:1789478409.963347:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964413184 00000100:00100000:2.0:1789478409.963368:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789478409.963374:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964413184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478409.963398:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964413184:12345-0@lo:400:kworker.0 Request processed in 25us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478409.963404:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789478409.963416:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789478409.963420:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789478409.963430:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964412288 00000100:00100000:2.0:1789478409.963433:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964412288 00000100:00100000:2.0:1789478409.963450:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789478409.963455:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876403964412288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478409.963734:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964412160:0@lo:400:kworker.0 00010000:00080000:3.0:1789478409.963746:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03599f80 x1876403964413184/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478409.963755:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964413184:0@lo:400:kworker.0 00000100:00100000:2.0:1789478409.964151:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876403964412288:12345-0@lo:400:kworker.0 Request processed in 695us (2326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478409.964158:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789478409.964231:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876403964412288:0@lo:400:kworker.0 00000100:00100000:3.0:1789478409.964370:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964413440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789478409.964401:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478409.964587:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964413440 00000100:00100000:1.0:1789478409.964616:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964413440 00000100:00100000:1.0:1789478409.964641:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789478409.964648:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964413440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789478409.964669:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789478409.964705:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964413440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478409.964711:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789478409.964868:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964413440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478410.469120:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964413568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789478410.469209:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478410.469296:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964413568 00000100:00100000:1.0:1789478410.469305:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964413568 00000100:00100000:1.0:1789478410.469360:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789478410.469371:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964413568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789478410.469412:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789478410.469469:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964413568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478410.469475:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1789478410.469518:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb036d6300 x1876403964413568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478410.469538:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964413568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789478410.470154:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789478410.470166:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964413696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789478410.470199:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478410.470225:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964413696 00000100:00100000:1.0:1789478410.470230:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964413696 00000100:00100000:1.0:1789478410.470256:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789478410.470263:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964413696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789478410.470276:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789478410.470308:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964413696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478410.470314:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1789478410.470342:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb036d6300 x1876403964413696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478410.470357:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964413696:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789478410.788755:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789478411.412561:0:10691:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1789478411.812994:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478412.839127:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478413.028722:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789478413.028745:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964413824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789478413.028813:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478413.028882:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964413824 00000100:00100000:0.0:1789478413.028890:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964413824 00000100:00100000:0.0:1789478413.028953:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789478413.028964:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964413824:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789478413.028965:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789478413.028992:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478413.029042:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964413824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478413.029051:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1789478413.029118:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc34cb6300 x1876403964413824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478413.029145:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964413824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789478413.448029:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478413.448225:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945479296 00000100:00100000:2.0:1789478413.448234:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945479296 00000100:00100000:2.0:1789478413.448285:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 273 00000100:00100000:2.0:1789478413.448296:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:2395:x1876403945479296:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1789478413.448373:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:2395:x1876403945479296:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 79us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478413.448380:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 273 00000100:00100000:1.0:1789478413.452551:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478413.452589:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478413.452640:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478413.452665:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478413.452690:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945479424 00000100:00100000:1.0:1789478413.452698:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945479424 00000100:00100000:1.0:1789478413.452750:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945479552 00000100:00100000:1.0:1789478413.452754:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945479552 00000100:00100000:1.0:1789478413.452777:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 64 00000100:00100000:1.0:1789478413.452787:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2395:x1876403945479424:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478413.452866:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2395:x1876403945479424:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 80us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478413.452874:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 64 00000100:00100000:1.0:1789478413.452891:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 65 00000100:00100000:1.0:1789478413.452899:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945479552:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478413.452927:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945479552:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 28us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478413.452933:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 65 00000100:00100000:1.0:1789478413.452954:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945479680 00000100:00100000:1.0:1789478413.452957:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945479680 00000100:00100000:1.0:1789478413.452982:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945479808 00000100:00100000:1.0:1789478413.452985:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945479808 00000100:00100000:1.0:1789478413.453005:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 26 00000100:00100000:1.0:1789478413.453012:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945479680:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478413.453045:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945479680:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 34us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478413.453052:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 26 00000100:00100000:1.0:1789478413.453063:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 27 00000100:00100000:1.0:1789478413.453069:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945479808:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478413.453088:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945479808:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 21us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478413.453093:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 27 00000100:00080000:1.0:1789478413.453106:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789478413.453109:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789478413.453111:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789478413.453113:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789478413.546771:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964413952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789478413.546834:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478413.546945:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964413952 00000100:00100000:0.0:1789478413.546953:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964413952 00000100:00100000:0.0:1789478413.547015:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789478413.547031:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964413952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789478413.547053:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478413.547095:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964413952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478413.547102:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1789478413.547231:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789478413.547262:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb036d5c00 x1876403964413952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478413.547280:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964413952:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789478413.860829:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478414.897412:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478415.076893:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964414080:0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.076954:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478415.076998:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876403964414592:0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.077024:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478415.077044:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964415104:0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.077065:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478415.077081:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964415616:0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.077098:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478415.077120:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789478415.077125:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964414464:0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.077144:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478415.077158:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964414976:0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.077174:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478415.077186:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964415488:0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.077204:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478415.077244:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964414336:0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.077264:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478415.077282:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876403964414848:0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.077323:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478415.077344:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876403964415360:0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.077372:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478415.077392:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789478415.077397:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876403964414208:0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.077417:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478415.077435:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876403964414720:0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.077454:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478415.077464:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876403964415232:0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.077482:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478415.077508:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964414080 00000100:00100000:2.0:1789478415.077514:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964414080 00000100:00100000:2.0:1789478415.077916:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789478415.077926:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3648:x1876403964414080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.077975:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3648:x1876403964414080:12345-0@lo:400:kworker.0 Request processed in 51us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478415.077982:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789478415.078010:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964414592 00000100:00100000:2.0:1789478415.078014:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964414592 00000100:00100000:2.0:1789478415.078030:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964414848 00000100:00100000:2.0:1789478415.078032:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964414848 00000100:00100000:2.0:1789478415.078049:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964415360 00000100:00100000:2.0:1789478415.078051:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964415360 00000100:00100000:2.0:1789478415.078060:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964414208 00000100:00100000:2.0:1789478415.078062:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964414208 00000100:00100000:2.0:1789478415.078071:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964414720 00000100:00100000:2.0:1789478415.078073:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964414720 00000100:00100000:2.0:1789478415.078082:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964415232 00000100:00100000:2.0:1789478415.078084:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964415232 00000100:00100000:2.0:1789478415.078095:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789478415.078100:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876403964414592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.078136:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876403964414592:12345-0@lo:400:kworker.0 Request processed in 36us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478415.078142:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789478415.078152:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789478415.078158:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876403964414848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.078182:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876403964414848:12345-0@lo:400:kworker.0 Request processed in 24us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478415.078187:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789478415.078198:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789478415.078203:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876403964415360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.078228:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876403964415360:12345-0@lo:400:kworker.0 Request processed in 25us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478415.078234:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789478415.078245:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789478415.078251:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876403964414208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.078275:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876403964414208:12345-0@lo:400:kworker.0 Request processed in 25us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478415.078280:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789478415.078290:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789478415.078696:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964415744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789478415.078728:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478415.078766:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964415104 00000100:00100000:0.0:1789478415.078771:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964415104 00000100:00100000:0.0:1789478415.078794:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964415616 00000100:00100000:0.0:1789478415.078797:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964415616 00000100:00100000:0.0:1789478415.078809:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964414976 00000100:00100000:0.0:1789478415.078812:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964414976 00000100:00100000:0.0:1789478415.078822:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964415488 00000100:00100000:0.0:1789478415.078825:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964415488 00000100:00100000:0.0:1789478415.078853:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789478415.078860:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964415104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478415.078892:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964415104:12345-0@lo:400:kworker.0 Request processed in 32us (1825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478415.078898:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789478415.078912:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789478415.078917:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964415616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478415.078943:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964415616:12345-0@lo:400:kworker.0 Request processed in 25us (1843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478415.078948:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789478415.078958:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789478415.078964:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964414976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478415.078999:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964414976:12345-0@lo:400:kworker.0 Request processed in 34us (1823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478415.079004:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789478415.079015:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789478415.079021:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964415488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478415.079044:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964415488:12345-0@lo:400:kworker.0 Request processed in 23us (1839us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478415.079050:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789478415.079067:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964414464 00000100:00100000:0.0:1789478415.079070:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964414464 00000100:00100000:0.0:1789478415.079087:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964414336 00000100:00100000:0.0:1789478415.079089:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964414336 00000100:00100000:0.0:1789478415.079099:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964415744 00000100:00100000:0.0:1789478415.079102:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964415744 00000100:00100000:0.0:1789478415.079111:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789478415.079117:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1876403964414464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478415.079147:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1876403964414464:12345-0@lo:400:kworker.0 Request processed in 30us (2002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478415.079153:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789478415.079164:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789478415.079169:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964414336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478415.079195:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964414336:12345-0@lo:400:kworker.0 Request processed in 25us (1929us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478415.079200:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789478415.079211:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789478415.079216:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964415744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789478415.079245:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789478415.079279:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964415744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478415.079285:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789478415.079334:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964415744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789478415.079654:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876403964414720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.079691:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876403964414720:12345-0@lo:400:kworker.0 Request processed in 1396us (2236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478415.079697:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789478415.079711:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789478415.079718:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876403964415232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.079747:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876403964415232:12345-0@lo:400:kworker.0 Request processed in 31us (2264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478415.079752:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1789478415.079794:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789478415.079797:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789478415.079800:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789478415.079802:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789478415.079857:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876403964414208:0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.079866:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876403964414720:0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.079875:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876403964415232:0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.079884:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964414336:0@lo:400:kworker.0 00010000:00080000:2.0:1789478415.079896:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c1c380 x1876403964414848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478415.079906:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876403964414848:0@lo:400:kworker.0 00010000:00080000:2.0:1789478415.079916:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c1d500 x1876403964415360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478415.079924:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876403964415360:0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.079957:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964414464:0@lo:400:kworker.0 00010000:00080000:2.0:1789478415.079967:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c1e680 x1876403964414976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478415.079974:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964414976:0@lo:400:kworker.0 00010000:00080000:2.0:1789478415.079983:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c1ea00 x1876403964415488/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478415.079996:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964415488:0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.080006:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964414080:0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.080015:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876403964414592:0@lo:400:kworker.0 00010000:00080000:2.0:1789478415.080024:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c1c000 x1876403964415104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478415.080031:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964415104:0@lo:400:kworker.0 00010000:00080000:2.0:1789478415.080040:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c1d880 x1876403964415616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478415.080047:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964415616:0@lo:400:kworker.0 00000100:00100000:2.0:1789478415.082097:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964415872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789478415.082163:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478415.082409:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964415872 00000100:00100000:0.0:1789478415.082417:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964415872 00000100:00100000:0.0:1789478415.082470:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789478415.082480:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964415872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789478415.082514:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789478415.082579:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964415872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478415.082586:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789478415.082663:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964415872:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1789478415.419388:0:10934:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing yml_node 00000100:00100000:1.0:1789478415.588771:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964416000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789478415.588850:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478415.588907:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964416000 00000100:00100000:1.0:1789478415.588915:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964416000 00000100:00100000:1.0:1789478415.588957:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789478415.588967:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964416000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789478415.588994:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789478415.589047:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964416000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478415.589054:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1789478415.589094:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb036d7480 x1876403964416000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478415.589111:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964416000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789478415.589877:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964416128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789478415.589910:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478415.594852:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964416128 00000100:00100000:2.0:1789478415.594867:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964416128 00000100:00100000:2.0:1789478415.594932:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789478415.594944:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964416128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789478415.594970:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789478415.595099:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964416128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (5187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478415.595106:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1789478415.598559:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c6f800 x1876403964416128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478415.598586:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964416128:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789478415.910767:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478416.933277:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478417.969049:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478418.149506:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964416256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789478418.149573:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478418.150013:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964416256 00000100:00100000:2.0:1789478418.150022:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964416256 00000100:00100000:2.0:1789478418.150070:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789478418.150080:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964416256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789478418.150114:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789478418.150166:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964416256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478418.150174:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1789478418.150215:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3cbc6300 x1876403964416256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478418.150234:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964416256:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789478418.152517:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1789478418.399273:0:11118:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.84 00000100:00100000:3.0:1789478418.560291:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478418.560526:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478418.560553:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478418.560576:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478418.560622:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478418.560647:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945479936 00000100:00100000:3.0:1789478418.560655:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945479936 00000100:00100000:3.0:1789478418.560694:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 275 00000100:00100000:3.0:1789478418.560704:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:2396:x1876403945479936:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478418.560766:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:2396:x1876403945479936:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 63us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478418.560774:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 275 00000100:00100000:3.0:1789478418.560805:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945480448 00000100:00100000:3.0:1789478418.560810:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945480448 00000100:00100000:3.0:1789478418.560858:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945480320 00000100:00100000:3.0:1789478418.560861:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945480320 00000100:00100000:3.0:1789478418.560897:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 32 00000100:00100000:3.0:1789478418.560905:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945480448:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478418.560936:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945480448:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 32us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478418.560943:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 32 00000100:00100000:3.0:1789478418.560956:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 33 00000100:00100000:3.0:1789478418.560963:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0359aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945480320:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478418.560986:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0359aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945480320:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 24us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478418.560993:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 33 00000100:00080000:3.0:1789478418.562731:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789478418.562737:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789478418.564626:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945480192 00000100:00100000:2.0:1789478418.564639:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945480192 00000100:00100000:2.0:1789478418.564705:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945480064 00000100:00100000:2.0:1789478418.564709:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945480064 00000100:00100000:2.0:1789478418.564737:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 72 00000100:00100000:2.0:1789478418.564749:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945480192:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1789478418.564860:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945480192:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 113us (4333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478418.564868:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 72 00000100:00100000:2.0:1789478418.564884:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 73 00000100:00100000:2.0:1789478418.564892:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0359b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2396:x1876403945480064:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1789478418.564917:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0359b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2396:x1876403945480064:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 27us (4340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478418.564924:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 73 00000100:00080000:2.0:1789478418.565612:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789478418.565617:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789478418.660791:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789478418.660827:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964416384:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789478418.660892:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478418.661055:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964416384 00000100:00100000:1.0:1789478418.661063:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964416384 00000100:00100000:1.0:1789478418.661133:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789478418.661142:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0359b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964416384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789478418.661163:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789478418.661209:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0359b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964416384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478418.661216:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1789478418.661251:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb036d5180 x1876403964416384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478418.661268:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964416384:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789478418.661337:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789478418.981135:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478420.007840:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478420.197225:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964416512:0@lo:400:kworker.0 00000100:00100000:0.0:1789478420.197295:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478420.197339:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964417024:0@lo:400:kworker.0 00000100:00100000:0.0:1789478420.197365:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478420.197382:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964417536:0@lo:400:kworker.0 00000100:00100000:0.0:1789478420.197419:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478420.197434:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964418048:0@lo:400:kworker.0 00000100:00100000:0.0:1789478420.197455:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478420.197476:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789478420.197482:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964416640:0@lo:400:kworker.0 00000100:00100000:0.0:1789478420.197502:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478420.197517:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964417152:0@lo:400:kworker.0 00000100:00100000:0.0:1789478420.197536:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478420.197550:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876403964417664:0@lo:400:kworker.0 00000100:00100000:0.0:1789478420.197570:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478420.197612:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964416768:0@lo:400:kworker.0 00000100:00100000:0.0:1789478420.197636:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478420.197650:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964417280:0@lo:400:kworker.0 00000100:00100000:0.0:1789478420.197670:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478420.197680:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876403964417792:0@lo:400:kworker.0 00000100:00100000:0.0:1789478420.197698:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478420.197709:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789478420.197714:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964416896:0@lo:400:kworker.0 00000100:00100000:0.0:1789478420.197731:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478420.197747:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964417408:0@lo:400:kworker.0 00000100:00100000:0.0:1789478420.197765:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478420.197778:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964417920:0@lo:400:kworker.0 00000100:00100000:0.0:1789478420.197815:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478420.197844:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964416512 00000100:00100000:0.0:1789478420.197856:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964416512 00000100:00100000:0.0:1789478420.197897:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789478420.197905:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964416512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478420.197950:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964416512:12345-0@lo:400:kworker.0 Request processed in 46us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478420.197958:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789478420.197987:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964416768 00000100:00100000:0.0:1789478420.197991:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964416768 00000100:00100000:2.0:1789478420.198308:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964417024 00000100:00100000:2.0:1789478420.198312:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964417024 00000100:00100000:2.0:1789478420.198332:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964416640 00000100:00100000:2.0:1789478420.198335:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964416640 00000100:00100000:2.0:1789478420.198345:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964417152 00000100:00100000:2.0:1789478420.198347:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964417152 00000100:00100000:2.0:1789478420.198366:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964417664 00000100:00100000:2.0:1789478420.198369:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964417664 00000100:00100000:2.0:1789478420.198379:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964417280 00000100:00100000:2.0:1789478420.198381:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964417280 00000100:00100000:2.0:1789478420.198391:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964417792 00000100:00100000:2.0:1789478420.198393:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964417792 00000100:00100000:2.0:1789478420.198404:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789478420.198410:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb034fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964417024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478420.198446:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb034fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964417024:12345-0@lo:400:kworker.0 Request processed in 36us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478420.198452:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789478420.198464:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789478420.198470:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb034fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964416640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478420.198495:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb034fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964416640:12345-0@lo:400:kworker.0 Request processed in 26us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478420.198501:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789478420.198512:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789478420.198518:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb034f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964417152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478420.198542:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb034f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964417152:12345-0@lo:400:kworker.0 Request processed in 25us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478420.198548:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789478420.198558:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789478420.198564:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb034faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876403964417664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478420.198621:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb034faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876403964417664:12345-0@lo:400:kworker.0 Request processed in 57us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478420.198627:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789478420.198639:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789478420.198644:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb034f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964417280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478420.198676:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb034f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964417280:12345-0@lo:400:kworker.0 Request processed in 32us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478420.198682:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789478420.198693:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789478420.198699:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb034f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876403964417792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478420.198723:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb034f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876403964417792:12345-0@lo:400:kworker.0 Request processed in 25us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478420.198729:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789478420.198744:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964417536 00000100:00100000:2.0:1789478420.198747:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964417536 00000100:00100000:2.0:1789478420.198764:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964418048 00000100:00100000:2.0:1789478420.198767:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964418048 00000100:00100000:2.0:1789478420.198775:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964417408 00000100:00100000:2.0:1789478420.198777:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964417408 00000100:00100000:2.0:1789478420.198786:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964417920 00000100:00100000:2.0:1789478420.198788:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964417920 00000100:00100000:2.0:1789478420.198799:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789478420.198818:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cb77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964417536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478420.198845:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cb77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964417536:12345-0@lo:400:kworker.0 Request processed in 40us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478420.198850:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789478420.198967:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789478420.198981:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb034f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964418048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478420.199010:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb034f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964418048:12345-0@lo:400:kworker.0 Request processed in 31us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478420.199015:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789478420.199026:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789478420.199032:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb034fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964417408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478420.199057:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb034fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964417408:12345-0@lo:400:kworker.0 Request processed in 26us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478420.199063:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789478420.199073:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789478420.199078:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964417920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478420.199101:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964417920:12345-0@lo:400:kworker.0 Request processed in 23us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478420.199106:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789478420.199131:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964416896 00000100:00100000:2.0:1789478420.199134:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964416896 00000100:00100000:2.0:1789478420.199155:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789478420.199161:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb034fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964416896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478420.199191:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb034fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964416896:12345-0@lo:400:kworker.0 Request processed in 30us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478420.199197:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1789478420.199218:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789478420.199221:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789478420.199224:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789478420.199226:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789478420.199255:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964416896:0@lo:400:kworker.0 00010000:00080000:2.0:1789478420.199281:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb034fb800 x1876403964417408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478420.199290:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964417408:0@lo:400:kworker.0 00010000:00080000:2.0:1789478420.199298:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb034f8a80 x1876403964417920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478420.199305:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964417920:0@lo:400:kworker.0 00010000:00080000:2.0:1789478420.199315:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb034f9180 x1876403964417280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478420.199322:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964417280:0@lo:400:kworker.0 00010000:00080000:2.0:1789478420.199330:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb034f8e00 x1876403964417792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478420.199338:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876403964417792:0@lo:400:kworker.0 00000100:00100000:0.0:1789478420.199450:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789478420.199457:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb034f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964416768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478420.199494:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb034f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964416768:12345-0@lo:400:kworker.0 Request processed in 38us (1856us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478420.199501:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789478420.199528:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964416768:0@lo:400:kworker.0 00000100:00100000:0.0:1789478420.199552:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964416640:0@lo:400:kworker.0 00000100:00100000:0.0:1789478420.199563:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964417152:0@lo:400:kworker.0 00000100:00100000:0.0:1789478420.199572:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876403964417664:0@lo:400:kworker.0 00000100:00100000:0.0:1789478420.199581:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964416512:0@lo:400:kworker.0 00000100:00100000:0.0:1789478420.199590:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964417024:0@lo:400:kworker.0 00010000:00080000:0.0:1789478420.199617:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb034fad80 x1876403964417536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478420.199625:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964417536:0@lo:400:kworker.0 00010000:00080000:0.0:1789478420.199634:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb034f8380 x1876403964418048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478420.199651:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964418048:0@lo:400:kworker.0 00000100:00100000:0.0:1789478420.199669:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789478420.199677:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964418176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789478420.199705:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478420.199731:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964418176 00000100:00100000:0.0:1789478420.199735:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964418176 00000100:00100000:0.0:1789478420.199757:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789478420.199763:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964418176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789478420.199785:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789478420.199838:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964418176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478420.199844:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789478420.199875:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964418176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789478420.200001:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789478420.200009:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964418304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789478420.200037:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478420.200061:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964418304 00000100:00100000:3.0:1789478420.200065:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964418304 00000100:00100000:3.0:1789478420.200087:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789478420.200093:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0359a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964418304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789478420.200107:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789478420.200139:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0359a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964418304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478420.200151:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789478420.200179:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964418304:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1789478420.602493:0:11215:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.84 00000100:00100000:0.0:1789478420.709971:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964418432:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789478420.710034:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478420.710086:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964418432 00000100:00100000:0.0:1789478420.710093:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964418432 00000100:00100000:0.0:1789478420.710136:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789478420.710145:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964418432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789478420.710171:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478420.710216:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964418432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478420.710223:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1789478420.710263:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c6ad80 x1876403964418432/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478420.710287:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964418432:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789478420.710972:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789478420.710984:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964418560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789478420.711019:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478420.711061:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964418560 00000100:00100000:1.0:1789478420.711065:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964418560 00000100:00100000:1.0:1789478420.711091:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789478420.711283:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964418560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789478420.711298:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789478420.711330:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964418560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478420.711336:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1789478420.711366:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c6e300 x1876403964418560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478420.711381:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964418560:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789478421.028731:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478422.059457:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789478422.283897:0:11312:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.84 00010000:00010000:1.0:1789478423.081473:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478423.269302:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964418688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789478423.269406:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478423.269492:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964418688 00000100:00100000:1.0:1789478423.269500:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964418688 00000100:00080000:3.0:1789478423.269557:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789478423.269567:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789478423.269577:0:8433:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1789478423.269578:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964418688:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789478423.269588:0:8433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1789478423.269653:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789478423.269892:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964418688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 315us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478423.269900:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1789478423.269940:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c6ce00 x1876403964418688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478423.269958:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964418688:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1789478423.301202:0:11361:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 15 09:20:21 EDT 2026 00000100:00100000:3.0:1789478423.682170:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478423.682205:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478423.682248:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478423.682342:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945480832 00000100:00100000:0.0:1789478423.682351:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945480832 00000100:00100000:0.0:1789478423.682415:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945480704 00000100:00100000:0.0:1789478423.682418:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945480704 00000100:00100000:0.0:1789478423.682443:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 80 00000100:00100000:0.0:1789478423.682453:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0359b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945480832:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478423.682516:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0359b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945480832:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 64us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478423.682524:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 80 00000100:00100000:0.0:1789478423.682544:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 81 00000100:00100000:2.0:1789478423.682553:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945480576 00000100:00100000:0.0:1789478423.682553:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0359ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2397:x1876403945480704:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1789478423.682560:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945480576 00000100:00100000:0.0:1789478423.682583:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0359ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2397:x1876403945480704:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 31us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478423.682618:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 277 00000100:00100000:0.0:1789478423.682626:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 81 00000100:00100000:2.0:1789478423.682631:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:2397:x1876403945480576:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1789478423.682666:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:2397:x1876403945480576:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 38us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478423.682686:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 277 00000100:00080000:3.0:1789478423.682741:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789478423.682745:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789478423.685469:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478423.685519:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478423.685637:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945480960 00000100:00100000:0.0:1789478423.685646:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945480960 00000100:00100000:0.0:1789478423.685705:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945481088 00000100:00100000:0.0:1789478423.685709:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945481088 00000100:00100000:0.0:1789478423.685733:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:0.0:1789478423.685740:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2394:x1876403945480960:12345-192.168.206.11@tcp:9:kworker.0 00000020:00000080:0.0:1789478423.685768:0:8829:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215daa 00000100:00080000:0.0:1789478423.685781:0:8829:0:(import.c:65:import_set_state_nolock()) ffff8ebc40fbd800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789478423.685827:0:8829:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00080000:1.0:1789478423.685935:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789478423.685940:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789478423.685958:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478423.685975:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:0.0:1789478423.685977:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+2:2394:x1876403945480960:12345-192.168.206.11@tcp:9:kworker.0 Request processed in 233us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478423.685989:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:1.0:1789478423.685990:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2394:x1876403945481088:12345-192.168.206.11@tcp:9:kworker.0 00000020:00000080:1.0:1789478423.686014:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215db1 00000100:00080000:1.0:1789478423.686029:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8ebc40fbb000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789478423.686062:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:0.0:1789478423.686139:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478423.686175:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+2:2394:x1876403945481088:12345-192.168.206.11@tcp:9:kworker.0 Request processed in 191us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478423.686183:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:3.0:1789478423.781127:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789478423.781148:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964418816:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789478423.781207:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478423.781318:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964418816 00000100:00100000:1.0:1789478423.781325:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964418816 00000100:00100000:1.0:1789478423.781392:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789478423.781403:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964418816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789478423.781423:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789478423.781467:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964418816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478423.781475:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1789478423.781500:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb036d7b80 x1876403964418816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478423.781518:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964418816:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789478423.781992:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789478424.102806:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478425.124806:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478425.318050:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789478425.318074:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964418944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789478425.318138:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478425.318201:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964418944 00000100:00100000:3.0:1789478425.318207:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964418944 00000100:00100000:3.0:1789478425.318246:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789478425.318255:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964418944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789478425.318286:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789478425.318328:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964418944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478425.318335:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789478425.318380:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964418944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789478425.322312:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964419072:0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.322379:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478425.322416:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964419584:0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.322443:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478425.322463:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876403964420096:0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.322482:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478425.322503:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789478425.322508:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964419200:0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.322527:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478425.322542:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964419712:0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.322562:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478425.322577:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964420224:0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.322626:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478425.322654:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964419072 00000100:00100000:3.0:1789478425.322662:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964419072 00000100:00100000:3.0:1789478425.322703:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789478425.322712:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964419072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.322759:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964419072:12345-0@lo:400:kworker.0 Request processed in 48us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478425.322766:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789478425.322816:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964419584 00000100:00100000:3.0:1789478425.322820:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964419584 00000100:00100000:3.0:1789478425.322844:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964420096 00000100:00100000:3.0:1789478425.322847:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964420096 00000100:00100000:3.0:1789478425.322859:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964419200 00000100:00100000:3.0:1789478425.322861:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964419200 00000100:00100000:3.0:1789478425.322869:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964419712 00000100:00100000:3.0:1789478425.322871:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964419712 00000100:00100000:3.0:1789478425.322890:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964420224 00000100:00100000:3.0:1789478425.322893:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964420224 00000100:00100000:3.0:1789478425.322905:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789478425.322911:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964419584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.322942:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964419584:12345-0@lo:400:kworker.0 Request processed in 31us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478425.322948:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789478425.322958:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789478425.322963:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876403964420096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.322984:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876403964420096:12345-0@lo:400:kworker.0 Request processed in 21us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478425.322989:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789478425.322998:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789478425.323003:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964419200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.323022:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964419200:12345-0@lo:400:kworker.0 Request processed in 19us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478425.323027:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789478425.323036:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789478425.323040:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964419712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.323060:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964419712:12345-0@lo:400:kworker.0 Request processed in 20us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478425.323065:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789478425.323073:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789478425.323078:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964420224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.323097:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964420224:12345-0@lo:400:kworker.0 Request processed in 19us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478425.323110:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1789478425.323134:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789478425.323138:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789478425.323147:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964419328:0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.323180:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478425.323199:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964419840:0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.323217:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478425.323232:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964420352:0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.323247:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478425.323270:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789478425.323275:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964419456:0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.323293:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478425.323305:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964419968:0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.323320:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478425.323333:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964420480:0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.323347:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478425.323369:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964419328 00000100:00100000:3.0:1789478425.323372:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964419328 00000100:00100000:3.0:1789478425.323394:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789478425.323399:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964419328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.323428:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964419328:12345-0@lo:400:kworker.0 Request processed in 30us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478425.323434:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789478425.323447:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964419840 00000100:00100000:3.0:1789478425.323450:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964419840 00000100:00100000:3.0:1789478425.323474:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964420352 00000100:00100000:3.0:1789478425.323477:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964420352 00000100:00100000:3.0:1789478425.323486:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964419968 00000100:00100000:3.0:1789478425.323488:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964419968 00000100:00100000:3.0:1789478425.323497:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964420480 00000100:00100000:3.0:1789478425.323499:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964420480 00000100:00100000:3.0:1789478425.323510:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789478425.323515:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03676a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964419840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.323540:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03676a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964419840:12345-0@lo:400:kworker.0 Request processed in 26us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478425.323546:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789478425.323555:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789478425.323560:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03675880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964420352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.323589:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03675880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964420352:12345-0@lo:400:kworker.0 Request processed in 29us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478425.323616:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789478425.323630:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789478425.323637:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03675c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964419968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.323660:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03675c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964419968:12345-0@lo:400:kworker.0 Request processed in 24us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478425.323666:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789478425.323676:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789478425.323681:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03677100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964420480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.323705:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03677100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964420480:12345-0@lo:400:kworker.0 Request processed in 24us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478425.323711:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1789478425.323736:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789478425.323744:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789478425.323757:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964419456 00000100:00100000:3.0:1789478425.323761:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964419456 00000100:00100000:1.0:1789478425.323774:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789478425.323800:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789478425.323800:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964420608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789478425.323810:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964419456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478425.323838:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478425.323848:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964419456:12345-0@lo:400:kworker.0 Request processed in 38us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478425.323855:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789478425.323883:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964420608 00000100:00100000:1.0:1789478425.323888:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964420608 00000100:00100000:3.0:1789478425.323895:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964419200:0@lo:400:kworker.0 00010000:00080000:3.0:1789478425.323913:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f61180 x1876403964419712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478425.323916:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789478425.323927:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964420608:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789478425.323929:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964419712:0@lo:400:kworker.0 00010000:00080000:3.0:1789478425.323944:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f63480 x1876403964420224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478425.323951:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964420224:0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.323960:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964419072:0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.323969:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964419584:0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.323978:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876403964420096:0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.324006:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964419456:0@lo:400:kworker.0 00010000:00080000:3.0:1789478425.324015:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f62d80 x1876403964419968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478425.324022:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964419968:0@lo:400:kworker.0 00010000:00080000:3.0:1789478425.324039:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f62300 x1876403964420480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478425.324045:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964420480:0@lo:400:kworker.0 00000100:00100000:3.0:1789478425.324053:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964419328:0@lo:400:kworker.0 00010000:00080000:3.0:1789478425.324060:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f60a80 x1876403964419840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478425.324067:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964419840:0@lo:400:kworker.0 00010000:00080000:3.0:1789478425.324076:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f63800 x1876403964420352/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478425.324082:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964420352:0@lo:400:kworker.0 00000004:00000024:1.0:1789478425.324122:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789478425.324165:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964420608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 240us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478425.324172:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789478425.327101:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964420608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789478425.828949:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964420736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789478425.829022:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478425.829249:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964420736 00000100:00100000:0.0:1789478425.829258:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964420736 00000100:00100000:0.0:1789478425.829330:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789478425.829343:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03677480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964420736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789478425.829375:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478425.829448:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03677480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964420736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478425.829458:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1789478425.829649:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c6ad80 x1876403964420736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478425.829669:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964420736:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789478425.829806:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789478425.829932:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964420864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789478425.829964:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478425.830052:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964420864 00000100:00100000:1.0:1789478425.830058:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964420864 00000100:00100000:1.0:1789478425.830124:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789478425.830144:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964420864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789478425.830158:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789478425.830239:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964420864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478425.830245:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1789478425.830314:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c6c380 x1876403964420864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478425.830329:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964420864:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789478426.152155:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478427.172817:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478428.197811:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478428.388787:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964420992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789478428.388851:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478428.388970:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964420992 00000100:00100000:3.0:1789478428.388977:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964420992 00000100:00100000:3.0:1789478428.389044:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789478428.389054:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964420992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789478428.389080:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478428.389134:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964420992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478428.389150:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1789478428.389249:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789478428.389284:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c6c380 x1876403964420992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478428.389308:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964420992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789478428.798533:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478428.798685:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478428.798713:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945481344 00000100:00100000:3.0:1789478428.798721:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945481344 00000100:00080000:0.0:1789478428.798752:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789478428.798813:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 88 00000100:00100000:2.0:1789478428.799069:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945481216 00000100:00100000:2.0:1789478428.799074:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945481216 00000100:00100000:2.0:1789478428.799115:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 279 00000100:00100000:2.0:1789478428.799123:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:2395:x1876403945481216:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1789478428.799184:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:2395:x1876403945481216:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 61us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478428.799191:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 279 00000100:00100000:3.0:1789478428.799463:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2395:x1876403945481344:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478428.799839:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2395:x1876403945481344:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 1015us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478428.799847:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 88 00000100:00100000:2.0:1789478428.799933:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478428.800043:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945481472 00000100:00100000:3.0:1789478428.800048:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945481472 00000100:00100000:3.0:1789478428.802895:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 89 00000100:00100000:3.0:1789478428.802909:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945481472:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478428.802981:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945481472:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 76us (3047us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478428.802990:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 89 00000100:00080000:2.0:1789478428.803818:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789478428.904073:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789478428.904097:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964421120:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789478428.904162:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478428.904582:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964421120 00000100:00100000:1.0:1789478428.904590:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964421120 00000100:00100000:1.0:1789478428.904665:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1789478428.904743:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789478428.904745:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964421120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789478428.904775:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789478428.904833:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964421120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478428.904841:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1789478428.905156:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb036d5880 x1876403964421120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478428.905175:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964421120:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789478429.220873:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789478429.930487:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 327dd6d5-45fd-4b52-99bf-74d27d1ede6e 00000020:00000080:0.0:1789478429.930496:0:8425:0:(genops.c:885:class_export_put()) final put ffff8ebc40fb9800/327dd6d5-45fd-4b52-99bf-74d27d1ede6e 00000020:00000080:3.0:1789478429.930771:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc40fb9800/327dd6d5-45fd-4b52-99bf-74d27d1ede6e for lustre-OST0000 00000020:00000080:3.0:1789478429.931128:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc40fbd800 for lustre-OST0000 00000001:00100000:0.0:1789478429.931186:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 327dd6d5-45fd-4b52-99bf-74d27d1ede6e 00000020:00000080:0.0:1789478429.931206:0:9510:0:(genops.c:885:class_export_put()) final put ffff8ebc40fbb800/327dd6d5-45fd-4b52-99bf-74d27d1ede6e 00000020:00000080:3.0:1789478429.931336:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc40fbb800/327dd6d5-45fd-4b52-99bf-74d27d1ede6e for lustre-OST0001 00000020:00000080:3.0:1789478429.931365:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc40fbb000 for lustre-OST0001 00010000:00010000:1.0:1789478430.245635:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478430.436857:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964421632:0@lo:400:kworker.0 00000100:00100000:3.0:1789478430.436986:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478430.437036:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03676680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964422144:0@lo:400:kworker.0 00000100:00100000:3.0:1789478430.437062:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478430.437091:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964422656:0@lo:400:kworker.0 00000100:00100000:3.0:1789478430.437114:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478430.437137:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789478430.437143:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03675180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964421248:0@lo:400:kworker.0 00000100:00100000:3.0:1789478430.437182:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478430.437203:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964421760:0@lo:400:kworker.0 00000100:00100000:3.0:1789478430.437224:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478430.437241:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964422272:0@lo:400:kworker.0 00000100:00100000:3.0:1789478430.437262:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478430.437277:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964422784:0@lo:400:kworker.0 00000100:00100000:3.0:1789478430.437295:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478430.437320:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964421376:0@lo:400:kworker.0 00000100:00100000:3.0:1789478430.437348:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478430.437367:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964421888:0@lo:400:kworker.0 00000100:00100000:1.0:1789478430.437376:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964422144 00000100:00100000:1.0:1789478430.437385:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964422144 00000100:00100000:3.0:1789478430.437390:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478430.437409:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964422400:0@lo:400:kworker.0 00000100:00100000:3.0:1789478430.437432:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478430.437447:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964422656 00000100:00100000:1.0:1789478430.437452:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964422656 00000100:00100000:3.0:1789478430.437457:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964422912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478430.437469:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964422272 00000100:00100000:1.0:1789478430.437473:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964422272 00000100:00100000:1.0:1789478430.437489:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964422784 00000100:00100000:1.0:1789478430.437492:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964422784 00000100:00100000:3.0:1789478430.437499:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478430.437510:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789478430.437522:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964422144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478430.437524:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789478430.437534:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964421504:0@lo:400:kworker.0 00000100:00100000:3.0:1789478430.437560:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478430.437581:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964422016:0@lo:400:kworker.0 00000100:00100000:1.0:1789478430.437611:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964422144:12345-0@lo:400:kworker.0 Request processed in 74us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478430.437631:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789478430.437633:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478430.437652:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789478430.437660:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876403964422528:0@lo:400:kworker.0 00000100:00100000:1.0:1789478430.437663:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964422656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478430.437693:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478430.437710:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964422656:12345-0@lo:400:kworker.0 Request processed in 48us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478430.437717:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789478430.437728:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964421632 00000100:00100000:3.0:1789478430.437733:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964421632 00000100:00100000:1.0:1789478430.437734:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789478430.437744:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964422272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478430.437772:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964422912 00000100:00100000:3.0:1789478430.437777:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964422912 00000100:00100000:1.0:1789478430.437788:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964422272:12345-0@lo:400:kworker.0 Request processed in 45us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478430.437793:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964421504 00000100:00100000:1.0:1789478430.437797:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789478430.437798:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964421504 00000100:00100000:1.0:1789478430.437819:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789478430.437823:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789478430.437831:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964422784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478430.437836:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964421632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478430.437863:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964422784:12345-0@lo:400:kworker.0 Request processed in 35us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478430.437871:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789478430.437889:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964421632:12345-0@lo:400:kworker.0 Request processed in 57us (903us total) trans 0 rc 0/0 00000100:00080000:1.0:1789478430.437891:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789478430.437896:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789478430.437900:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789478430.437912:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789478430.437921:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789478430.437924:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1876403964422912:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789478430.437933:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1876403964421504:12345-0@lo:400:kworker.0 00000004:00000024:1.0:1789478430.437950:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789478430.437972:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1876403964421504:12345-0@lo:400:kworker.0 Request processed in 42us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478430.437980:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789478430.437992:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964422912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478430.437999:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789478430.438006:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964421248 00000100:00100000:3.0:1789478430.438011:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964421248 00000100:00100000:3.0:1789478430.438040:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00010000:00080000:1.0:1789478430.438045:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03674000 x1876403964422272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478430.438049:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964421248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478430.438070:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964422272:0@lo:400:kworker.0 00000100:00100000:3.0:1789478430.438088:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964421248:12345-0@lo:400:kworker.0 Request processed in 40us (904us total) trans 0 rc 0/0 00010000:00080000:1.0:1789478430.438090:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f62300 x1876403964422784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478430.438101:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1789478430.438110:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964422784:0@lo:400:kworker.0 00000100:00100000:1.0:1789478430.438125:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964421632:0@lo:400:kworker.0 00000100:00100000:3.0:1789478430.438289:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964421760 00000100:00100000:3.0:1789478430.438294:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964421760 00000100:00100000:3.0:1789478430.438312:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964421376 00000100:00100000:3.0:1789478430.438321:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964421376 00000100:00100000:3.0:1789478430.438335:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964421888 00000100:00100000:3.0:1789478430.438338:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964421888 00000100:00100000:3.0:1789478430.438395:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964422400 00000100:00100000:3.0:1789478430.438398:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964422400 00010000:00080000:1.0:1789478430.438504:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03676680 x1876403964422144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478430.438514:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03676680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964422144:0@lo:400:kworker.0 00010000:00080000:1.0:1789478430.438526:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f60a80 x1876403964422656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478430.438533:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964422656:0@lo:400:kworker.0 00000100:00100000:1.0:1789478430.438560:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03675180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964421248:0@lo:400:kworker.0 00000100:00100000:1.0:1789478430.438726:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964422016 00000100:00100000:1.0:1789478430.438731:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964422016 00000100:00080000:2.0:1789478430.446404:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789478430.446414:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789478430.447100:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964422528 00000100:00100000:0.0:1789478430.447112:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964422528 00000100:00100000:0.0:1789478430.447174:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789478430.447184:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964421760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478430.447280:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964421760:12345-0@lo:400:kworker.0 Request processed in 98us (10054us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478430.447288:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789478430.447306:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789478430.447313:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0359aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964421376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478430.447348:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0359aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964421376:12345-0@lo:400:kworker.0 Request processed in 35us (10000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478430.447354:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789478430.447365:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789478430.447372:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964421888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478430.447401:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964421888:12345-0@lo:400:kworker.0 Request processed in 29us (10011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478430.447406:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789478430.447419:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789478430.447425:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876403964422528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478430.447451:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876403964422528:12345-0@lo:400:kworker.0 Request processed in 27us (9759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478430.447472:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789478430.447504:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964423040:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789478430.447542:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478430.447625:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964421504:0@lo:400:kworker.0 00010000:00080000:0.0:1789478430.447642:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f63800 x1876403964422528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478430.447653:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876403964422528:0@lo:400:kworker.0 00000100:00100000:0.0:1789478430.447672:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964422912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789478430.447683:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964421376:0@lo:400:kworker.0 00000100:00100000:0.0:1789478430.447693:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964421888:0@lo:400:kworker.0 00000100:00080000:2.0:1789478430.447783:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789478430.448854:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964421760:0@lo:400:kworker.0 00000100:00100000:1.0:1789478430.455803:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789478430.455826:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964422016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478430.455906:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964422016:12345-0@lo:400:kworker.0 Request processed in 92us (18275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478430.455915:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:1.0:1789478430.455977:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03674380 x1876403964422016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478430.456001:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964422016:0@lo:400:kworker.0 00000100:00100000:1.0:1789478430.457232:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964423040 00000100:00100000:1.0:1789478430.457241:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964423040 00000100:00100000:1.0:1789478430.457289:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789478430.457301:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964423040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789478430.457332:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789478430.457394:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964423040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (9849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478430.457402:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789478430.457461:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964423040:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789478430.460675:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789478430.460692:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964422400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478430.460819:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964422400:12345-0@lo:400:kworker.0 Request processed in 132us (23385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478430.460828:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789478430.460882:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964422400:0@lo:400:kworker.0 00000100:00100000:3.0:1789478430.949950:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789478430.949974:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964423168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789478430.950108:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478430.950152:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964423168 00000100:00100000:0.0:1789478430.950161:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964423168 00000100:00100000:0.0:1789478430.950213:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789478430.950222:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964423168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789478430.950248:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478430.950299:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964423168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478430.950306:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1789478430.950419:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c6a680 x1876403964423168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478430.950438:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964423168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789478430.956004:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964423296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789478430.956139:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478430.956191:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964423296 00000100:00100000:1.0:1789478430.956200:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964423296 00000100:00100000:1.0:1789478430.956264:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789478430.956276:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964423296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789478430.956298:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1789478430.961348:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c68000 x1876403964423296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478430.961348:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964423296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5065us (5199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478430.961367:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789478430.961378:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964423296:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789478431.269093:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478432.293029:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789478433.004197:0:11990:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 09:20:31 (1789478431) === 00010000:00010000:1.0:1789478433.318050:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478433.437464:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478433.437563:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945481600 00000100:00100000:0.0:1789478433.437572:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945481600 00000100:00100000:0.0:1789478433.437654:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 281 00000100:00100000:0.0:1789478433.437665:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:8707:x1876403945481600:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789478433.437679:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478433.437707:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc35b66800/0x8ebaae74e8215e9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b71d5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478433.437736:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc35b66800/0x8ebaae74e8215e9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b71d5 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478433.437759:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc35b66800/0x8ebaae74e8215e9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b71d5 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478433.437769:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b66800, rc 0) 00000100:00100000:0.0:1789478433.437824:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+11:8707:x1876403945481600:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 161us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478433.437831:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 281 00000100:00100000:3.0:1789478433.444926:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478433.445033:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945481728 00000100:00100000:0.0:1789478433.445042:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945481728 00000100:00100000:0.0:1789478433.445137:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 282 00000100:00100000:0.0:1789478433.445148:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+11:8707:x1876403945481728:12345-192.168.206.11@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789478433.445308:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+11:8707:x1876403945481728:12345-192.168.206.11@tcp:501:mount.lustre.0 Request processed in 161us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478433.445316:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 282 00000100:00100000:3.0:1789478433.450216:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478433.450662:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945481856 00000100:00100000:2.0:1789478433.450673:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945481856 00000100:00100000:2.0:1789478433.450733:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 283 00000100:00100000:2.0:1789478433.450755:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+11:8707:x1876403945481856:12345-192.168.206.11@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789478433.450896:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+11:8707:x1876403945481856:12345-192.168.206.11@tcp:503:mount.lustre.0 Request processed in 143us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478433.451995:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 283 00000100:00100000:2.0:1789478433.454719:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478433.456037:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945481984 00000100:00100000:0.0:1789478433.456049:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945481984 00000100:00100000:0.0:1789478433.456127:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 284 00000100:00100000:0.0:1789478433.456140:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+11:8711:x1876403945481984:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789478433.456305:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+11:8711:x1876403945481984:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 167us (1592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478433.456314:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 284 00000100:00100000:0.0:1789478433.475326:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478433.475428:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945482112 00000100:00100000:2.0:1789478433.475437:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945482112 00000100:00100000:2.0:1789478433.475489:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 285 00000100:00100000:2.0:1789478433.475499:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+11:8711:x1876403945482112:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789478433.475680:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+11:8711:x1876403945482112:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 182us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478433.475688:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 285 00000100:00100000:3.0:1789478433.477446:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478433.477692:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945482240 00000100:00100000:0.0:1789478433.477701:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945482240 00000100:00100000:0.0:1789478433.477802:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 286 00000100:00100000:0.0:1789478433.477813:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+11:8711:x1876403945482240:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789478433.477956:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+11:8711:x1876403945482240:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 145us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478433.477963:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 286 00000100:00100000:0.0:1789478433.486449:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478433.492945:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945482368 00000100:00100000:3.0:1789478433.492959:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945482368 00000100:00100000:3.0:1789478433.493027:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 287 00000100:00100000:3.0:1789478433.493037:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+11:8707:x1876403945482368:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789478433.493052:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478433.493081:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebb035fd200/0x8ebaae74e8215ea6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7206 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478433.493110:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebb035fd200/0x8ebaae74e8215ea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7206 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478433.493122:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebb035fd200/0x8ebaae74e8215ea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7206 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478433.493132:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fd200, rc 0) 00000100:00100000:3.0:1789478433.493199:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+12:8707:x1876403945482368:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 162us (6757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478433.493206:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 287 00000100:00100000:3.0:1789478433.504001:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478433.504882:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945482496 00000100:00100000:0.0:1789478433.504894:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945482496 00000100:00100000:1.0:1789478433.505041:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 288 00000100:00100000:1.0:1789478433.505052:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+12:8707:x1876403945482496:12345-192.168.206.11@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789478433.505218:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789478433.505243:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789478433.505247:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789478433.505250:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789478433.505253:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789478433.505256:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1789478433.508357:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+12:8707:x1876403945482496:12345-192.168.206.11@tcp:256:mount.lustre.0 Request processed in 3296us (4354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478433.508370:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 288 00000100:00100000:3.0:1789478433.509487:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964423424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789478433.509581:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478433.509651:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964423424 00000100:00100000:0.0:1789478433.509659:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964423424 00000100:00100000:0.0:1789478433.509722:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789478433.509733:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964423424:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789478433.509816:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789478433.509907:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478433.510012:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964423424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 281us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478433.510020:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1789478433.515449:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c6ea00 x1876403964423424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478433.515475:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964423424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789478433.515919:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478433.516097:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945482624 00000100:00100000:3.0:1789478433.516104:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945482624 00000100:00100000:0.0:1789478433.516272:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 289 00000100:00100000:0.0:1789478433.516283:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+12:8707:x1876403945482624:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789478433.516299:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478433.516315:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc35b67a00/0x8ebaae74e8215ead lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b720d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478433.516341:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc35b67a00/0x8ebaae74e8215ead lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b720d expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478433.516366:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc35b67a00/0x8ebaae74e8215ead lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b720d expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478433.516376:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b67a00, rc 0) 00000100:00100000:0.0:1789478433.516491:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:8707:x1876403945482624:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 210us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478433.516499:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 289 00000100:00100000:3.0:1789478433.519958:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478433.520142:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945482752 00000100:00100000:1.0:1789478433.520150:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945482752 00000100:00100000:1.0:1789478433.520250:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 290 00000100:00100000:1.0:1789478433.520260:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10002850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:8707:x1876403945482752:12345-192.168.206.11@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789478433.520403:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10002850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:8707:x1876403945482752:12345-192.168.206.11@tcp:501:mount.lustre.0 Request processed in 144us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478433.520412:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 290 00000100:00100000:0.0:1789478433.522548:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478433.523297:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945482880 00000100:00100000:2.0:1789478433.523306:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945482880 00000100:00100000:2.0:1789478433.523354:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 291 00000100:00100000:2.0:1789478433.523362:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10001050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:8707:x1876403945482880:12345-192.168.206.11@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789478433.523865:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10001050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:8707:x1876403945482880:12345-192.168.206.11@tcp:503:mount.lustre.0 Request processed in 501us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478433.523873:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 291 00000100:00100000:0.0:1789478433.527890:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478433.527982:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945483008 00000100:00100000:2.0:1789478433.527991:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945483008 00000100:00100000:2.0:1789478433.528052:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 292 00000100:00100000:2.0:1789478433.528063:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:8713:x1876403945483008:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789478433.528208:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:8713:x1876403945483008:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 146us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478433.528216:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 292 00000100:00100000:0.0:1789478433.536564:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478433.536823:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945483136 00000100:00100000:2.0:1789478433.536832:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945483136 00000100:00100000:2.0:1789478433.536891:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 293 00000100:00100000:2.0:1789478433.536903:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:8713:x1876403945483136:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789478433.537048:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:8713:x1876403945483136:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 147us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478433.537056:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 293 00000100:00100000:0.0:1789478433.547311:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478433.547348:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478433.547381:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478433.547562:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945483264 00000100:00100000:3.0:1789478433.547582:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945483264 00000100:00100000:3.0:1789478433.547655:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945483392 00000100:00100000:3.0:1789478433.547659:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945483392 00000100:00100000:3.0:1789478433.547693:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945483520 00000100:00100000:3.0:1789478433.547696:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945483520 00000100:00100000:3.0:1789478433.547714:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 96 00000100:00100000:3.0:1789478433.547746:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2396:x1876403945483392:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478433.547819:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2396:x1876403945483392:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 84us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478433.547825:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 96 00000100:00100000:3.0:1789478433.547840:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 97 00000100:00100000:3.0:1789478433.547847:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945483520:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478433.547872:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945483520:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 25us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478433.547877:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 97 00000100:00100000:3.0:1789478433.547891:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:3.0:1789478433.547895:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1876403945483264:12345-192.168.206.11@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789478433.547914:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6a1d5e8d-e61d-452f-a651-9ee87fa9267a@192.168.206.11@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:3.0:1789478433.547944:0:6518:0:(genops.c:1385:class_connect()) connect: client 6a1d5e8d-e61d-452f-a651-9ee87fa9267a, cookie 0x8ebaae74e8215eb4 00000004:00100000:3.0:1789478433.547968:0:6518:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789478433.548521:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8ebc40fbd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789478433.548553:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+6:2394:x1876403945483264:12345-192.168.206.11@tcp:38:mount.lustre.0 Request processed in 655us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478433.548560:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00080000:3.0:1789478433.549836:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789478433.550872:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789478433.550967:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478433.551051:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945483776 00000100:00100000:3.0:1789478433.551061:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945483776 00000100:00100000:3.0:1789478433.551092:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:3.0:1789478433.551107:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1876403945483776:12345-192.168.206.11@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789478433.551133:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 6a1d5e8d-e61d-452f-a651-9ee87fa9267a@192.168.206.11@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:3.0:1789478433.551179:0:6518:0:(genops.c:1385:class_connect()) connect: client 6a1d5e8d-e61d-452f-a651-9ee87fa9267a, cookie 0x8ebaae74e8215ebb 00000004:00100000:3.0:1789478433.551201:0:6518:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789478433.551310:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8ebc40fba800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789478433.551633:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+6:2394:x1876403945483776:12345-192.168.206.11@tcp:38:mount.lustre.0 Request processed in 524us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478433.551642:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:2.0:1789478433.556924:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478433.556969:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478433.557052:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945483648 00000100:00100000:3.0:1789478433.557061:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945483648 00000100:00100000:3.0:1789478433.557129:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945483904 00000100:00100000:3.0:1789478433.557132:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945483904 00000100:00100000:3.0:1789478433.557160:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:3.0:1789478433.557169:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+6:0:x1876403945483648:12345-192.168.206.11@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789478433.557208:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789478433.557297:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+6:0:x1876403945483648:12345-192.168.206.11@tcp:41:mount.lustre.0 Request processed in 129us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478433.557305:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:3.0:1789478433.557323:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:3.0:1789478433.557329:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+6:0:x1876403945483904:12345-192.168.206.11@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789478433.557346:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789478433.557384:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+6:0:x1876403945483904:12345-192.168.206.11@tcp:41:mount.lustre.0 Request processed in 55us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478433.557775:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00080000:0.0:1789478433.558209:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789478433.558214:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789478433.559949:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478433.560040:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945484032 00000100:00100000:3.0:1789478433.560049:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945484032 00000100:00100000:3.0:1789478433.560099:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:3.0:1789478433.560109:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+6:8707:x1876403945484032:12345-192.168.206.11@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789478433.560151:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789478433.560218:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+6:8707:x1876403945484032:12345-192.168.206.11@tcp:41:mount.lustre.0 Request processed in 110us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478433.560225:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:1.0:1789478433.564387:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478433.564761:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945484160 00000100:00100000:3.0:1789478433.564770:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945484160 00000100:00100000:3.0:1789478433.564858:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:3.0:1789478433.564867:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+6:8707:x1876403945484160:12345-192.168.206.11@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789478433.564942:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+6:8707:x1876403945484160:12345-192.168.206.11@tcp:40:mount.lustre.0 Request processed in 77us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478433.564950:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:0.0:1789478433.566946:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478433.567021:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478433.567111:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478433.567175:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945484544 00000100:00100000:2.0:1789478433.567181:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945484544 00000100:00100000:2.0:1789478433.567225:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:2.0:1789478433.567233:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+6:8707:x1876403945484544:12345-192.168.206.11@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789478433.567294:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+6:8707:x1876403945484544:12345-192.168.206.11@tcp:900:mount.lustre.0 Request processed in 62us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478433.567311:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:1.0:1789478433.567745:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945484288 00000100:00100000:1.0:1789478433.567750:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945484288 00000100:00100000:3.0:1789478433.567762:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945484416 00000100:00100000:3.0:1789478433.567766:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945484416 00000100:00100000:1.0:1789478433.567842:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:1.0:1789478433.567848:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2394:x1876403945484288:12345-192.168.206.11@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789478433.567873:0:8431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6a1d5e8d-e61d-452f-a651-9ee87fa9267a@192.168.206.11@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:1.0:1789478433.567903:0:8431:0:(genops.c:1385:class_connect()) connect: client 6a1d5e8d-e61d-452f-a651-9ee87fa9267a, cookie 0x8ebaae74e8215ec2 00002000:00100000:1.0:1789478433.567913:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6a1d5e8d-e61d-452f-a651-9ee87fa9267a/ffff8ebb03685800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789478433.567923:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789478433.567989:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789478433.568020:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8ebb03681800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789478433.568071:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+6:2394:x1876403945484288:12345-192.168.206.11@tcp:8:mount.lustre.0 Request processed in 221us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478433.568078:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:1.0:1789478433.568091:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:1.0:1789478433.568096:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2394:x1876403945484416:12345-192.168.206.11@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789478433.568112:0:8431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6a1d5e8d-e61d-452f-a651-9ee87fa9267a@192.168.206.11@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:1.0:1789478433.568127:0:8431:0:(genops.c:1385:class_connect()) connect: client 6a1d5e8d-e61d-452f-a651-9ee87fa9267a, cookie 0x8ebaae74e8215ec9 00002000:00100000:1.0:1789478433.568133:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6a1d5e8d-e61d-452f-a651-9ee87fa9267a/ffff8ebb03686000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789478433.568145:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789478433.568173:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789478433.568186:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8ebb03681000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789478433.568209:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+6:2394:x1876403945484416:12345-192.168.206.11@tcp:8:mount.lustre.0 Request processed in 111us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478433.568216:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:0.0:1789478433.570869:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478433.570944:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945484672 00000100:00100000:3.0:1789478433.570954:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945484672 00000100:00100000:3.0:1789478433.571001:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 1 00000100:00100000:3.0:1789478433.571010:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+6:8707:x1876403945484672:12345-192.168.206.11@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789478433.571089:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789478433.571163:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+6:8707:x1876403945484672:12345-192.168.206.11@tcp:33:mount.lustre.0 Request processed in 154us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478433.571171:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 1 00000100:00100000:0.0:1789478434.024489:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964423552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789478434.024549:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478434.024809:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964423552 00000100:00100000:1.0:1789478434.024817:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964423552 00000100:00100000:1.0:1789478434.024875:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789478434.024889:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964423552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789478434.024909:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789478434.024944:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964423552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478434.024951:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1789478434.025061:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb036d5c00 x1876403964423552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789478434.025205:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789478434.025230:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964423552:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789478434.344762:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478435.364837:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478435.561646:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964423680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789478435.561709:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478435.561789:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964423680 00000100:00100000:3.0:1789478435.561796:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964423680 00000100:00100000:3.0:1789478435.561837:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789478435.561856:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964423680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789478435.561886:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789478435.561930:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964423680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478435.561937:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789478435.561981:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964423680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789478435.562358:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964424064:0@lo:400:kworker.0 00000100:00100000:2.0:1789478435.562402:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478435.562431:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964424576:0@lo:400:kworker.0 00000100:00100000:2.0:1789478435.562454:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478435.562471:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964425088:0@lo:400:kworker.0 00000100:00100000:2.0:1789478435.562491:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478435.562510:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789478435.562515:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876403964423936:0@lo:400:kworker.0 00000100:00100000:2.0:1789478435.562536:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478435.562549:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876403964424448:0@lo:400:kworker.0 00000100:00100000:2.0:1789478435.562566:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478435.562582:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876403964424960:0@lo:400:kworker.0 00000100:00100000:2.0:1789478435.562625:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478435.562650:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964424064 00000100:00100000:2.0:1789478435.562654:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964424064 00000100:00100000:2.0:1789478435.562678:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789478435.562684:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964424064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478435.562721:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964424064:12345-0@lo:400:kworker.0 Request processed in 36us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478435.562739:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789478435.562757:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964424576 00000100:00100000:2.0:1789478435.562760:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964424576 00000100:00100000:2.0:1789478435.562782:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964425088 00000100:00100000:2.0:1789478435.562792:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964425088 00000100:00100000:2.0:1789478435.562820:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789478435.562826:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964424576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478435.562856:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964424576:12345-0@lo:400:kworker.0 Request processed in 31us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478435.562862:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789478435.562872:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789478435.562878:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c895880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964425088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478435.562905:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c895880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964425088:12345-0@lo:400:kworker.0 Request processed in 27us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478435.562910:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789478435.562933:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964423936 00000100:00100000:2.0:1789478435.562936:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964423936 00000100:00100000:2.0:1789478435.562953:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964424448 00000100:00100000:2.0:1789478435.562955:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964424448 00000100:00100000:2.0:1789478435.562966:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964424960 00000100:00100000:2.0:1789478435.562968:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964424960 00000100:00100000:2.0:1789478435.562982:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789478435.562987:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876403964423936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478435.563016:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876403964423936:12345-0@lo:400:kworker.0 Request processed in 28us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478435.563022:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789478435.563034:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789478435.563040:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876403964424448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478435.563067:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876403964424448:12345-0@lo:400:kworker.0 Request processed in 27us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478435.563072:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789478435.563091:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789478435.563109:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876403964424960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478435.563138:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876403964424960:12345-0@lo:400:kworker.0 Request processed in 42us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478435.563145:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:2.0:1789478435.563167:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789478435.563171:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789478435.563190:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876403964423936:0@lo:400:kworker.0 00010000:00080000:2.0:1789478435.563202:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb034fad80 x1876403964424448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478435.563211:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876403964424448:0@lo:400:kworker.0 00010000:00080000:2.0:1789478435.563220:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb034f9180 x1876403964424960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478435.563228:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876403964424960:0@lo:400:kworker.0 00000100:00100000:2.0:1789478435.563236:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964424064:0@lo:400:kworker.0 00010000:00080000:2.0:1789478435.563245:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb034fa300 x1876403964424576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478435.563253:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964424576:0@lo:400:kworker.0 00010000:00080000:2.0:1789478435.563261:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb034f8a80 x1876403964425088/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478435.563268:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964425088:0@lo:400:kworker.0 00000100:00100000:3.0:1789478435.563636:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964424192:0@lo:400:kworker.0 00000100:00100000:3.0:1789478435.563665:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478435.563686:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964424704:0@lo:400:kworker.0 00000100:00100000:3.0:1789478435.563705:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478435.563722:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964425216:0@lo:400:kworker.0 00000100:00100000:3.0:1789478435.563754:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478435.563773:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789478435.563779:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964423808:0@lo:400:kworker.0 00000100:00100000:3.0:1789478435.563804:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478435.563830:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964424320:0@lo:400:kworker.0 00000100:00100000:3.0:1789478435.563851:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478435.563868:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876403964424832:0@lo:400:kworker.0 00000100:00100000:3.0:1789478435.563888:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478435.563911:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964424192 00000100:00100000:3.0:1789478435.563915:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964424192 00000100:00100000:3.0:1789478435.563936:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964424320 00000100:00100000:3.0:1789478435.563938:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964424320 00000100:00100000:3.0:1789478435.563956:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964424832 00000100:00100000:3.0:1789478435.563958:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964424832 00000100:00100000:3.0:1789478435.563971:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789478435.563985:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964424192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478435.564022:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964424192:12345-0@lo:400:kworker.0 Request processed in 37us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478435.564028:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789478435.564041:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789478435.564047:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964424320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478435.564073:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964424320:12345-0@lo:400:kworker.0 Request processed in 27us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478435.564079:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789478435.564090:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789478435.564109:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876403964424832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478435.564136:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876403964424832:12345-0@lo:400:kworker.0 Request processed in 41us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478435.564142:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789478435.564163:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964424704 00000100:00100000:3.0:1789478435.564166:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964424704 00000100:00100000:3.0:1789478435.564190:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964425216 00000100:00100000:3.0:1789478435.564193:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964425216 00000100:00100000:3.0:1789478435.564208:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789478435.564215:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964424704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478435.564258:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964424704:12345-0@lo:400:kworker.0 Request processed in 44us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478435.564265:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789478435.564277:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789478435.564284:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964425216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478435.564310:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964425216:12345-0@lo:400:kworker.0 Request processed in 28us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478435.564322:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789478435.564558:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964423808 00000100:00100000:3.0:1789478435.564561:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964423808 00000100:00100000:3.0:1789478435.564585:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789478435.564591:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964423808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478435.564641:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964423808:12345-0@lo:400:kworker.0 Request processed in 50us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478435.564647:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789478435.564677:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964423808:0@lo:400:kworker.0 00000100:00100000:3.0:1789478435.564687:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964424320:0@lo:400:kworker.0 00000100:00100000:3.0:1789478435.564696:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876403964424832:0@lo:400:kworker.0 00000100:00100000:3.0:1789478435.564705:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964424192:0@lo:400:kworker.0 00010000:00080000:3.0:1789478435.564715:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb034f8700 x1876403964424704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478435.564724:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964424704:0@lo:400:kworker.0 00010000:00080000:3.0:1789478435.564749:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb034fb800 x1876403964425216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478435.564757:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964425216:0@lo:400:kworker.0 00000100:00080000:3.0:1789478435.564794:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789478435.564797:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789478435.564799:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789478435.575980:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789478435.576001:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964425344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789478435.576065:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478435.579010:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964425344 00000100:00100000:0.0:1789478435.579022:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964425344 00000100:00100000:0.0:1789478435.579077:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789478435.579087:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964425344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789478435.579134:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789478435.579214:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964425344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (3148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478435.579221:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789478435.582296:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964425344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789478436.070356:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964425600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789478436.070424:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478436.070471:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789478436.070478:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964425472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789478436.070502:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478436.070548:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964425600 00000100:00100000:3.0:1789478436.070569:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964425600 00000100:00100000:0.0:1789478436.070647:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964425472 00000100:00100000:0.0:1789478436.070652:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964425472 00000100:00100000:3.0:1789478436.070670:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789478436.070682:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964425600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789478436.070709:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478436.070772:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964425600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478436.070780:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789478436.070798:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789478436.070806:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb034fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964425472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789478436.070817:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478436.070841:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb034fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964425472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478436.070847:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1789478436.070881:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03635880 x1876403964425472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478436.070898:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964425472:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789478436.070910:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03635f80 x1876403964425600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478436.070920:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964425600:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789478436.388757:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478437.413172:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478438.447060:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789478438.463058:0:12182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1789478438.632521:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964425728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789478438.632588:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478438.632683:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964425728 00000100:00100000:3.0:1789478438.632690:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964425728 00000100:00100000:3.0:1789478438.632781:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789478438.632799:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964425728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789478438.632827:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478438.632871:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964425728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478438.632878:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1789478438.632898:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789478438.632948:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03635f80 x1876403964425728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478438.632966:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964425728:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1789478438.639912:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6a1d5e8d-e61d-452f-a651-9ee87fa9267a 00000001:00100000:1.0:1789478438.641853:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6a1d5e8d-e61d-452f-a651-9ee87fa9267a 00000001:00100000:3.0:1789478438.642621:0:6496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6a1d5e8d-e61d-452f-a651-9ee87fa9267a 00000001:00100000:3.0:1789478438.645894:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6a1d5e8d-e61d-452f-a651-9ee87fa9267a 00000100:00100000:3.0:1789478439.038582:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478439.038654:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478439.038689:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478439.038731:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478439.038753:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478439.038772:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478439.038829:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478439.038866:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945485568 00000100:00100000:3.0:1789478439.038874:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945485568 00000100:00100000:3.0:1789478439.038923:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945485440 00000100:00100000:3.0:1789478439.038927:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945485440 00000100:00100000:3.0:1789478439.038957:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 50 00000100:00100000:0.0:1789478439.038960:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945484800 00000100:00100000:0.0:1789478439.038967:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945484800 00000100:00100000:3.0:1789478439.038969:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2398:x1876403945485568:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478439.039004:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 295 00000100:00100000:0.0:1789478439.039013:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2398:x1876403945484800:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478439.039082:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2398:x1876403945484800:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 58us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478439.039090:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 295 00000100:00100000:2.0:1789478439.039116:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945485056 00000100:00100000:2.0:1789478439.039121:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945485056 00000100:00100000:2.0:1789478439.039147:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945485312 00000100:00100000:2.0:1789478439.039151:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945485312 00000100:00100000:2.0:1789478439.039180:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945484928 00000100:00100000:2.0:1789478439.039183:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945484928 00000100:00100000:2.0:1789478439.039194:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945485184 00000100:00100000:2.0:1789478439.039197:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945485184 00000100:00100000:2.0:1789478439.039214:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 104 00000100:00100000:2.0:1789478439.039222:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2398:x1876403945485056:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1789478439.039263:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2398:x1876403945485056:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 42us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478439.039270:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 104 00000100:00100000:0.0:1789478439.039275:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:0.0:1789478439.039286:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2398:x1876403945485440:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478439.039313:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2398:x1876403945485440:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 30us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478439.039320:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:0.0:1789478439.039345:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 105 00000100:00100000:0.0:1789478439.039352:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2398:x1876403945485312:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478439.039376:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2398:x1876403945485312:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 26us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478439.039389:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 105 00000100:00100000:0.0:1789478439.039403:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 106 00000100:00100000:0.0:1789478439.039411:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2398:x1876403945484928:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478439.039473:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2398:x1876403945484928:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 63us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478439.039479:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 106 00000100:00100000:0.0:1789478439.039492:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 107 00000100:00100000:0.0:1789478439.039498:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2398:x1876403945485184:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478439.039518:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2398:x1876403945485184:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 21us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478439.039524:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 107 00000100:00080000:0.0:1789478439.039538:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789478439.039542:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789478439.039545:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789478439.039547:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789478439.043659:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2398:x1876403945485568:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 4684us (4918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478439.043688:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 50 00000100:00100000:3.0:1789478439.141897:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964425856:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789478439.141975:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478439.143695:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964425856 00000100:00100000:0.0:1789478439.143703:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964425856 00000100:00100000:3.0:1789478439.143852:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789478439.143861:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964425856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789478439.143882:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478439.143944:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964425856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478439.143951:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1789478439.143992:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c68700 x1876403964425856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478439.144010:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964425856:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789478439.144079:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789478439.464119:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478440.485327:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478440.676888:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876403964426112:0@lo:400:kworker.0 00000100:00100000:2.0:1789478440.676951:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478440.676997:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876403964426624:0@lo:400:kworker.0 00000100:00100000:2.0:1789478440.677019:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478440.677041:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876403964427136:0@lo:400:kworker.0 00000100:00100000:2.0:1789478440.677063:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478440.677116:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1789478440.677123:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964425984:0@lo:400:kworker.0 00000100:00100000:2.0:1789478440.677151:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478440.677173:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876403964426496:0@lo:400:kworker.0 00000100:00100000:2.0:1789478440.677195:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478440.677210:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964427008:0@lo:400:kworker.0 00000100:00100000:2.0:1789478440.677231:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478440.677246:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964427520:0@lo:400:kworker.0 00000100:00100000:2.0:1789478440.677266:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478440.677290:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964426240:0@lo:400:kworker.0 00000100:00100000:2.0:1789478440.677355:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478440.677374:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964426752:0@lo:400:kworker.0 00000100:00100000:2.0:1789478440.677395:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478440.677406:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964427264:0@lo:400:kworker.0 00000100:00100000:2.0:1789478440.677424:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478440.677437:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789478440.677443:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964426368:0@lo:400:kworker.0 00000100:00100000:2.0:1789478440.677463:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478440.677478:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964426880:0@lo:400:kworker.0 00000100:00100000:1.0:1789478440.677492:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964426112 00000100:00100000:2.0:1789478440.677496:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478440.677499:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964426112 00000100:00100000:2.0:1789478440.677524:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964427392:0@lo:400:kworker.0 00000100:00100000:1.0:1789478440.677532:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964426624 00000100:00100000:1.0:1789478440.677534:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964426624 00000100:00100000:2.0:1789478440.677543:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478440.677553:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964427136 00000100:00100000:1.0:1789478440.677555:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964427136 00000100:00100000:1.0:1789478440.677567:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964426496 00000100:00100000:2.0:1789478440.677568:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964426752 00000100:00100000:1.0:1789478440.677569:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964426496 00000100:00100000:2.0:1789478440.677570:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964426752 00000100:00100000:1.0:1789478440.677578:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964427264 00000100:00100000:1.0:1789478440.677580:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964427264 00000100:00100000:2.0:1789478440.677588:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789478440.677846:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876403964426112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478440.677909:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876403964426112:12345-0@lo:400:kworker.0 Request processed in 65us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478440.678585:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789478440.678605:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876403964426624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478440.678641:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876403964426624:12345-0@lo:400:kworker.0 Request processed in 50us (1622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478440.678648:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789478440.678665:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789478440.678671:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876403964427136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478440.678694:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876403964427136:12345-0@lo:400:kworker.0 Request processed in 24us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478440.678713:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789478440.678724:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789478440.678730:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876403964426496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478440.678756:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876403964426496:12345-0@lo:400:kworker.0 Request processed in 26us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478440.678770:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789478440.678783:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789478440.678789:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964426752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478440.678823:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964426752:12345-0@lo:400:kworker.0 Request processed in 34us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478440.678828:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789478440.678844:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789478440.678850:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964427264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478440.678876:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964427264:12345-0@lo:400:kworker.0 Request processed in 26us (1450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478440.678882:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789478440.678897:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789478440.678905:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964427648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478440.678930:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478440.678955:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964426240 00000100:00100000:1.0:1789478440.678960:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964426240 00000100:00100000:1.0:1789478440.678977:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964426368 00000100:00100000:1.0:1789478440.678980:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964426368 00000100:00100000:1.0:1789478440.678989:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964427648 00000100:00100000:1.0:1789478440.678992:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964427648 00000100:00100000:1.0:1789478440.679002:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789478440.679008:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1876403964426240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478440.679035:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1876403964426240:12345-0@lo:400:kworker.0 Request processed in 27us (1681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478440.679041:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789478440.679052:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789478440.679062:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964426368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478440.679091:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964426368:12345-0@lo:400:kworker.0 Request processed in 29us (1626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478440.679096:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789478440.679107:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789478440.679113:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964427648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789478440.679134:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789478440.679162:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964427648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478440.679168:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789478440.679198:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964427648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478440.682565:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964427008 00000100:00100000:1.0:1789478440.682577:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964427008 00000100:00100000:1.0:1789478440.682640:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964427520 00000100:00100000:1.0:1789478440.682644:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964427520 00000100:00100000:1.0:1789478440.682654:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964426880 00000100:00100000:1.0:1789478440.682656:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964426880 00000100:00100000:1.0:1789478440.682664:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964427392 00000100:00100000:1.0:1789478440.682666:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964427392 00000100:00100000:1.0:1789478440.682684:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789478440.682692:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964427008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478440.682765:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964427008:12345-0@lo:400:kworker.0 Request processed in 74us (5533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478440.682772:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789478440.682784:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789478440.682788:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964427520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478440.682808:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964427520:12345-0@lo:400:kworker.0 Request processed in 20us (5542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478440.682823:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789478440.682831:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789478440.682836:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964426880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478440.682856:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964426880:12345-0@lo:400:kworker.0 Request processed in 21us (5359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478440.682861:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789478440.682868:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789478440.682872:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964427392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478440.682895:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964427392:12345-0@lo:400:kworker.0 Request processed in 23us (5351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478440.682900:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1789478440.683236:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789478440.683240:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789478440.683243:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789478440.683245:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789478440.683375:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964425984 00000100:00100000:0.0:1789478440.683379:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964425984 00000100:00100000:0.0:1789478440.683430:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1789478440.683438:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3646:x1876403964425984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478440.683490:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3646:x1876403964425984:12345-0@lo:400:kworker.0 Request processed in 53us (6338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478440.683497:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1789478440.683543:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964425984:0@lo:400:kworker.0 00000100:00100000:0.0:1789478440.683559:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876403964426496:0@lo:400:kworker.0 00010000:00080000:0.0:1789478440.683572:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c6c380 x1876403964427008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478440.683582:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964427008:0@lo:400:kworker.0 00010000:00080000:0.0:1789478440.683608:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3cbc6d80 x1876403964427520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478440.683618:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964427520:0@lo:400:kworker.0 00000100:00100000:0.0:1789478440.683631:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876403964426112:0@lo:400:kworker.0 00000100:00100000:0.0:1789478440.683643:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876403964426624:0@lo:400:kworker.0 00000100:00100000:0.0:1789478440.683654:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876403964427136:0@lo:400:kworker.0 00000100:00100000:3.0:1789478440.687399:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789478440.687420:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964427776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789478440.687481:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478440.687568:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964427776 00000100:00100000:0.0:1789478440.687576:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964427776 00000100:00100000:0.0:1789478440.687633:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789478440.687642:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964427776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789478440.687672:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789478440.687732:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964427776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478440.687739:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789478440.687971:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964427776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789478440.687998:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789478440.688046:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964426368:0@lo:400:kworker.0 00010000:00080000:2.0:1789478440.688060:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c6f800 x1876403964426880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478440.688070:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964426880:0@lo:400:kworker.0 00010000:00080000:2.0:1789478440.688081:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3cbc7b80 x1876403964427392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478440.688089:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964427392:0@lo:400:kworker.0 00000100:00100000:2.0:1789478440.688099:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964426240:0@lo:400:kworker.0 00010000:00080000:2.0:1789478440.688111:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb034fad80 x1876403964426752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478440.688118:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964426752:0@lo:400:kworker.0 00010000:00080000:2.0:1789478440.688129:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c6e300 x1876403964427264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478440.688137:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964427264:0@lo:400:kworker.0 00000100:00100000:3.0:1789478441.189313:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789478441.189334:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964427904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789478441.189447:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478441.189488:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964427904 00000100:00100000:3.0:1789478441.189494:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964427904 00000100:00100000:3.0:1789478441.189530:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789478441.189538:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964427904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789478441.189562:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478441.189623:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964427904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478441.189630:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1789478441.189667:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40ed4a80 x1876403964427904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478441.189683:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964427904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789478441.189794:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789478441.189803:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964428032:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789478441.189828:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478441.189862:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964428032 00000100:00100000:1.0:1789478441.189865:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964428032 00000100:00100000:1.0:1789478441.189886:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789478441.189905:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964428032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789478441.189915:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789478441.189943:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964428032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478441.189950:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1789478441.190037:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb036d6680 x1876403964428032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478441.190049:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964428032:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789478441.509967:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478442.542262:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478443.559090:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478443.749774:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964428160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789478443.749834:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478443.751448:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964428160 00000100:00100000:3.0:1789478443.751458:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964428160 00000100:00100000:3.0:1789478443.751529:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789478443.751539:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964428160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789478443.751576:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478443.751654:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964428160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (1820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478443.751661:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1789478443.753745:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789478443.753789:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb036d6680 x1876403964428160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478443.753811:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964428160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789478444.157051:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478444.157588:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945485696 00000100:00100000:0.0:1789478444.157624:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945485696 00000100:00100000:0.0:1789478444.157679:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 297 00000100:00100000:0.0:1789478444.157701:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10000850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2396:x1876403945485696:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478444.157774:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10000850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2396:x1876403945485696:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 75us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478444.157780:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 297 00000100:00100000:1.0:1789478444.157875:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478444.157996:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478444.158022:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478444.158053:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478444.158072:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478444.158091:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478444.158111:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945485952 00000100:00100000:1.0:1789478444.158115:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945485952 00000100:00100000:1.0:1789478444.158143:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945486208 00000100:00100000:1.0:1789478444.158147:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945486208 00000100:00100000:1.0:1789478444.158161:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945485824 00000100:00100000:1.0:1789478444.158163:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945485824 00000100:00100000:1.0:1789478444.158174:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945486080 00000100:00100000:1.0:1789478444.158177:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945486080 00000100:00100000:1.0:1789478444.158191:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 114 00000100:00100000:1.0:1789478444.158199:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945485952:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478444.158232:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945485952:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 34us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478444.158238:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 114 00000100:00100000:1.0:1789478444.158263:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 115 00000100:00100000:1.0:1789478444.158269:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945486208:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478444.158523:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945486208:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 252us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478444.158531:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 115 00000100:00100000:1.0:1789478444.158547:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 116 00000100:00100000:1.0:1789478444.158555:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2396:x1876403945485824:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478444.158581:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2396:x1876403945485824:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 27us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478444.158587:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 116 00000100:00100000:1.0:1789478444.158632:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 117 00000100:00100000:1.0:1789478444.158639:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945486080:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478444.158663:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945486080:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 24us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478444.158669:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 117 00000100:00100000:1.0:1789478444.158699:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945486464 00000100:00100000:1.0:1789478444.158703:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945486464 00000100:00100000:1.0:1789478444.158728:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945486336 00000100:00100000:1.0:1789478444.158730:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945486336 00000100:00100000:1.0:1789478444.158745:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 56 00000100:00100000:1.0:1789478444.158751:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945486464:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478444.158776:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945486464:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 25us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478444.158782:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 56 00000100:00100000:1.0:1789478444.158802:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:1.0:1789478444.158813:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03674380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945486336:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478444.158839:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03674380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945486336:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 31us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478444.158845:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00080000:1.0:1789478444.158864:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789478444.158867:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789478444.158869:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789478444.158871:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789478444.261669:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964428288:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789478444.261748:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478444.261946:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964428288 00000100:00100000:3.0:1789478444.261953:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964428288 00000100:00100000:3.0:1789478444.262047:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789478444.262056:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03674e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964428288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789478444.262075:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478444.262116:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03674e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964428288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478444.262122:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1789478444.262154:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40ed4a80 x1876403964428288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478444.262171:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964428288:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789478444.262221:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789478444.586434:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789478444.921423:0:12498:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789478444.921745:0:12498:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789478445.604936:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478445.796792:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964428416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789478445.796856:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478445.797025:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964428416 00000100:00100000:1.0:1789478445.797033:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964428416 00000100:00100000:1.0:1789478445.797079:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789478445.797088:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964428416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789478445.797119:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789478445.797170:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964428416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478445.797178:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789478445.797224:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964428416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789478445.797406:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964428544:0@lo:400:kworker.0 00000100:00100000:0.0:1789478445.797437:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478445.797469:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964429056:0@lo:400:kworker.0 00000100:00100000:0.0:1789478445.797500:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478445.797521:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964429568:0@lo:400:kworker.0 00000100:00100000:0.0:1789478445.797550:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478445.797571:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789478445.797578:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964428672:0@lo:400:kworker.0 00000100:00100000:0.0:1789478445.797625:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478445.797643:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964429184:0@lo:400:kworker.0 00000100:00100000:0.0:1789478445.797736:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478445.797756:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876403964429696:0@lo:400:kworker.0 00000100:00100000:0.0:1789478445.797790:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478445.797824:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964428544 00000100:00100000:0.0:1789478445.797834:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964428544 00000100:00100000:3.0:1789478445.797869:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964428800:0@lo:400:kworker.0 00000100:00100000:0.0:1789478445.797876:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1789478445.797886:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3645:x1876403964428544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478445.797908:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478445.797937:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964429312:0@lo:400:kworker.0 00000100:00100000:0.0:1789478445.798710:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3645:x1876403964428544:12345-0@lo:400:kworker.0 Request processed in 824us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478445.798719:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789478445.798750:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478445.798760:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964429056 00000100:00100000:0.0:1789478445.798766:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964429056 00000100:00100000:0.0:1789478445.798796:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964429568 00000100:00100000:0.0:1789478445.798800:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964429568 00000100:00100000:0.0:1789478445.798810:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964428672 00000100:00100000:0.0:1789478445.798813:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964428672 00000100:00100000:0.0:1789478445.798825:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964429184 00000100:00100000:0.0:1789478445.798828:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964429184 00000100:00100000:0.0:1789478445.798846:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964429696 00000100:00100000:0.0:1789478445.798849:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964429696 00000100:00100000:0.0:1789478445.798871:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789478445.798880:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb034f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964429056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478445.798963:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964429312 00000100:00100000:1.0:1789478445.798967:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964429312 00000100:00100000:1.0:1789478445.798994:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789478445.799001:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964429312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478445.799749:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964429824:0@lo:400:kworker.0 00000100:00100000:1.0:1789478445.799768:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964429312:12345-0@lo:400:kworker.0 Request processed in 766us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478445.799783:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789478445.799788:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789478445.799825:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c6f800 x1876403964429312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478445.799838:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964429312:0@lo:400:kworker.0 00000100:00100000:3.0:1789478445.799854:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789478445.799862:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964428928:0@lo:400:kworker.0 00000100:00100000:3.0:1789478445.799889:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478445.799901:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964429440:0@lo:400:kworker.0 00000100:00100000:3.0:1789478445.799921:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478445.800193:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb034f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964429056:12345-0@lo:400:kworker.0 Request processed in 1313us (2690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478445.800203:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789478445.800221:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964428928 00000100:00100000:0.0:1789478445.800226:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964428928 00000100:00100000:0.0:1789478445.800247:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789478445.800255:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb034f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964429568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478445.800293:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb034f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964429568:12345-0@lo:400:kworker.0 Request processed in 39us (2742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478445.800299:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789478445.800310:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789478445.800324:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb034fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964428672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478445.800352:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb034fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964428672:12345-0@lo:400:kworker.0 Request processed in 29us (2726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478445.800484:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964429824 00000100:00100000:1.0:1789478445.800488:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964429824 00000100:00100000:3.0:1789478445.800524:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb034f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964429952:0@lo:400:kworker.0 00000100:00100000:3.0:1789478445.800663:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478445.800815:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789478445.800830:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789478445.800837:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb034f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964429184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478445.800870:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb034f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964429184:12345-0@lo:400:kworker.0 Request processed in 34us (3134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478445.800876:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789478445.800887:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789478445.800893:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876403964429696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478445.800918:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876403964429696:12345-0@lo:400:kworker.0 Request processed in 26us (3129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478445.800924:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789478445.800934:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789478445.800940:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964428928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478445.801018:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964428928:12345-0@lo:400:kworker.0 Request processed in 78us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478445.801023:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1789478445.801066:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789478445.801070:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789478445.801072:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789478445.801797:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964429440 00000100:00100000:0.0:1789478445.801804:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964429440 00000100:00100000:3.0:1789478445.801815:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964428928:0@lo:400:kworker.0 00000100:00100000:0.0:1789478445.801839:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964429952 00000100:00100000:0.0:1789478445.801843:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964429952 00000100:00100000:3.0:1789478445.801847:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964428800 00000100:00100000:3.0:1789478445.801853:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964428800 00000100:00100000:0.0:1789478445.801862:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789478445.801880:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964429824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478445.801885:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789478445.801895:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964428800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478445.801936:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964429824:12345-0@lo:400:kworker.0 Request processed in 57us (2148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478445.801942:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964428800:12345-0@lo:400:kworker.0 Request processed in 48us (4033us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478445.801948:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789478445.801955:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789478445.801967:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789478445.801975:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964429440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478445.802005:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964429440:12345-0@lo:400:kworker.0 Request processed in 31us (2084us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478445.802011:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789478445.802022:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789478445.802028:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964429952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478445.802055:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964430080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789478445.802059:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964429952:12345-0@lo:400:kworker.0 Request processed in 29us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478445.802067:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1789478445.802086:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789478445.802090:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789478445.802091:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789478445.802115:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964430080 00000100:00100000:0.0:1789478445.802120:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964430080 00000100:00100000:3.0:1789478445.802123:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964428672:0@lo:400:kworker.0 00000100:00100000:0.0:1789478445.802141:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789478445.802148:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964430080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789478445.802169:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00010000:00080000:3.0:1789478445.802254:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c6e300 x1876403964429184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478445.802267:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964429184:0@lo:400:kworker.0 00010000:00080000:3.0:1789478445.802351:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb034fad80 x1876403964429696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478445.802362:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876403964429696:0@lo:400:kworker.0 00000100:00100000:3.0:1789478445.802436:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964428544:0@lo:400:kworker.0 00000100:00100000:0.0:1789478445.802988:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964430080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 838us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478445.802996:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789478445.803042:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964429056:0@lo:400:kworker.0 00000100:00100000:3.0:1789478445.803056:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964429568:0@lo:400:kworker.0 00000100:00100000:3.0:1789478445.803090:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964430080:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1789478445.803131:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c6ed80 x1876403964429440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478445.803152:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964429440:0@lo:400:kworker.0 00010000:00080000:3.0:1789478445.803162:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb034f8a80 x1876403964429952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478445.803171:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964429952:0@lo:400:kworker.0 00000100:00100000:3.0:1789478445.803185:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964428800:0@lo:400:kworker.0 00010000:00080000:3.0:1789478445.803195:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb034f8380 x1876403964429824/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478445.803210:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb034f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964429824:0@lo:400:kworker.0 00000100:00100000:3.0:1789478446.308948:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789478446.308967:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964430208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789478446.309026:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478446.309243:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964430208 00000100:00100000:3.0:1789478446.309250:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964430208 00000100:00100000:3.0:1789478446.309292:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789478446.309301:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964430208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789478446.309327:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478446.309369:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964430208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478446.309377:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1789478446.309413:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40ed4a80 x1876403964430208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478446.309431:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964430208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789478446.310865:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789478446.310878:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964430336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789478446.310918:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478446.310960:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964430336 00000100:00100000:3.0:1789478446.310965:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964430336 00000100:00100000:3.0:1789478446.310993:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789478446.311000:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964430336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789478446.311015:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478446.311045:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964430336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478446.311059:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789478446.311092:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40ed4a80 x1876403964430336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478446.311107:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964430336:0@lo:13:osp-pre-1-1.0 00000020:00000004:2.0:1789478446.334979:0:12596:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789478446.335178:0:12596:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789478446.629130:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478447.653857:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789478448.143292:0:12693:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789478448.143485:0:12693:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789478448.679192:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478448.872049:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964430464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789478448.872109:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478448.872184:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964430464 00000100:00100000:2.0:1789478448.872190:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964430464 00000100:00100000:2.0:1789478448.872239:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789478448.872248:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03787b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964430464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789478448.872275:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789478448.872373:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03787b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964430464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (263us total) trans 0 rc 0/0 00010000:00080000:0.0:1789478448.872378:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40ed4a80 x1876403964430464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478448.872380:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789478448.872397:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964430464:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789478448.872418:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789478449.303544:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478449.303579:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478449.303625:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478449.303649:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478449.303685:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478449.303706:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478449.303730:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478449.303772:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945486720 00000100:00100000:1.0:1789478449.303781:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945486720 00000100:00100000:1.0:1789478449.303833:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945486976 00000100:00100000:1.0:1789478449.303837:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945486976 00000100:00100000:1.0:1789478449.303863:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945486848 00000100:00100000:1.0:1789478449.303866:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945486848 00000100:00100000:1.0:1789478449.303877:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945487104 00000100:00100000:1.0:1789478449.303879:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945487104 00000100:00100000:1.0:1789478449.303892:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 124 00000100:00100000:1.0:1789478449.303901:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2396:x1876403945486720:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478449.303977:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2396:x1876403945486720:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 76us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478449.303985:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 124 00000100:00100000:1.0:1789478449.304001:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 125 00000100:00100000:1.0:1789478449.304008:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945486976:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478449.304035:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945486976:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 28us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478449.304054:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 125 00000100:00100000:1.0:1789478449.304067:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 126 00000100:00100000:1.0:1789478449.304073:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945486848:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478449.304098:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945486848:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 25us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478449.304105:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 126 00000100:00100000:1.0:1789478449.304117:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 127 00000100:00100000:1.0:1789478449.304123:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945487104:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478449.304143:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945487104:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 21us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478449.304149:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 127 00000100:00100000:1.0:1789478449.304179:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945486592 00000100:00100000:1.0:1789478449.304183:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945486592 00000100:00100000:1.0:1789478449.304210:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 299 00000100:00100000:1.0:1789478449.304216:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2396:x1876403945486592:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478449.304240:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2396:x1876403945486592:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 24us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478449.304246:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 299 00000100:00100000:1.0:1789478449.304293:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945487232 00000100:00100000:1.0:1789478449.304297:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945487232 00000100:00100000:1.0:1789478449.304323:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945487360 00000100:00100000:1.0:1789478449.304325:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945487360 00000100:00100000:1.0:1789478449.304342:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 62 00000100:00100000:1.0:1789478449.304348:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03676d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945487232:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478449.304381:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03676d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945487232:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 33us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478449.304388:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 62 00000100:00100000:1.0:1789478449.304399:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 63 00000100:00100000:1.0:1789478449.304404:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03676300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945487360:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478449.304422:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03676300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945487360:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 19us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478449.304428:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 63 00000100:00080000:1.0:1789478449.304441:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789478449.304445:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789478449.304447:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789478449.304450:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789478449.383055:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789478449.383078:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03785500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964430592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789478449.383141:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478449.383199:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964430592 00000100:00100000:0.0:1789478449.383206:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964430592 00000100:00100000:0.0:1789478449.383259:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789478449.383268:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964430592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789478449.383290:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478449.383333:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964430592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478449.383340:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1789478449.383360:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789478449.383386:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03785500 x1876403964430592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478449.383404:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03785500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964430592:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789478449.703352:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478450.724969:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478450.918294:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03785500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964430720:0@lo:400:kworker.0 00000100:00100000:0.0:1789478450.918359:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478450.918416:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03787100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876403964431232:0@lo:400:kworker.0 00000100:00100000:0.0:1789478450.918444:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478450.918468:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03787800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964431744:0@lo:400:kworker.0 00000100:00100000:0.0:1789478450.918492:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478450.918507:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964432256:0@lo:400:kworker.0 00000100:00100000:0.0:1789478450.918552:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478450.918575:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789478450.918581:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964431104:0@lo:400:kworker.0 00000100:00100000:0.0:1789478450.918627:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478450.918643:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964431616:0@lo:400:kworker.0 00000100:00100000:0.0:1789478450.918676:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478450.918691:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964432128:0@lo:400:kworker.0 00000100:00100000:0.0:1789478450.918709:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478450.918733:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964430848:0@lo:400:kworker.0 00000100:00100000:0.0:1789478450.918752:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478450.918765:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964431360:0@lo:400:kworker.0 00000100:00100000:0.0:1789478450.918782:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478450.918794:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876403964431872:0@lo:400:kworker.0 00000100:00100000:0.0:1789478450.918810:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478450.918825:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789478450.918830:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03785f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964430976:0@lo:400:kworker.0 00000100:00100000:0.0:1789478450.918849:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478450.918865:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964431488:0@lo:400:kworker.0 00000100:00100000:0.0:1789478450.918882:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478450.918890:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964432000:0@lo:400:kworker.0 00000100:00100000:0.0:1789478450.918905:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478450.918947:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964430720 00000100:00100000:0.0:1789478450.918967:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964430720 00000100:00100000:0.0:1789478450.919004:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1789478450.919013:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3646:x1876403964430720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478450.919058:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3646:x1876403964430720:12345-0@lo:400:kworker.0 Request processed in 46us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478450.919065:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1789478450.919094:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964431744 00000100:00100000:0.0:1789478450.919098:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964431744 00000100:00100000:0.0:1789478450.919125:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964432256 00000100:00100000:0.0:1789478450.919128:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964432256 00000100:00100000:0.0:1789478450.919141:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964431616 00000100:00100000:0.0:1789478450.919143:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964431616 00000100:00100000:0.0:1789478450.919154:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964432128 00000100:00100000:0.0:1789478450.919156:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964432128 00000100:00100000:0.0:1789478450.919169:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789478450.919175:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03786680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964431744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478450.919207:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03786680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964431744:12345-0@lo:400:kworker.0 Request processed in 31us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478450.919214:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789478450.919225:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789478450.919231:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964432256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478450.919257:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964432256:12345-0@lo:400:kworker.0 Request processed in 27us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478450.919263:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789478450.919274:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789478450.919280:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964431616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478450.919304:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964431616:12345-0@lo:400:kworker.0 Request processed in 25us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478450.919317:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789478450.919329:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789478450.919335:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964432128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478450.919363:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964432128:12345-0@lo:400:kworker.0 Request processed in 28us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478450.919368:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789478450.919383:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964431232 00000100:00100000:0.0:1789478450.919386:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964431232 00000100:00100000:0.0:1789478450.919401:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964430848 00000100:00100000:0.0:1789478450.919403:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964430848 00000100:00100000:0.0:1789478450.919413:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964431360 00000100:00100000:0.0:1789478450.919416:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964431360 00000100:00100000:0.0:1789478450.919432:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964431872 00000100:00100000:0.0:1789478450.919434:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964431872 00000100:00100000:0.0:1789478450.919445:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964431488 00000100:00100000:0.0:1789478450.919447:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964431488 00000100:00100000:0.0:1789478450.919458:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964432000 00000100:00100000:0.0:1789478450.919461:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964432000 00000100:00100000:0.0:1789478450.919474:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789478450.919481:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876403964431232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478450.919514:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876403964431232:12345-0@lo:400:kworker.0 Request processed in 33us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478450.919520:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789478450.919535:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789478450.919541:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964430848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478450.919579:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789478450.919589:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964430848:12345-0@lo:400:kworker.0 Request processed in 46us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478450.919613:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964431360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478450.919625:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789478450.919645:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789478450.919666:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876403964431872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478450.919696:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876403964431872:12345-0@lo:400:kworker.0 Request processed in 33us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478450.919701:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789478450.919715:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789478450.919722:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964431488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478450.919737:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964431360:12345-0@lo:400:kworker.0 Request processed in 148us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478450.919746:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789478450.919766:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789478450.919770:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964431488:12345-0@lo:400:kworker.0 Request processed in 35us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478450.919776:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964432000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478450.919782:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789478450.919808:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964431104 00000100:00100000:0.0:1789478450.919812:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964431104 00000100:00100000:1.0:1789478450.919817:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964432000:12345-0@lo:400:kworker.0 Request processed in 44us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478450.919825:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789478450.919841:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964430976 00000100:00100000:0.0:1789478450.919845:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964430976 00000100:00100000:1.0:1789478450.919865:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789478450.919875:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964431104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478450.919916:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964431104:12345-0@lo:400:kworker.0 Request processed in 43us (1287us total) trans 0 rc 0/0 00000020:00000004:2.0:1789478450.922863:0:12790:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789478450.923097:0:12790:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789478450.923923:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789478450.923935:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789478450.924054:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964432512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789478450.924206:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478450.924246:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789478450.924254:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964432384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478450.924256:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964432512 00000100:00100000:1.0:1789478450.924265:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964432512 00000100:00100000:0.0:1789478450.924287:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478450.924298:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964432384 00000100:00100000:1.0:1789478450.924303:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964432384 00000100:00100000:1.0:1789478450.924321:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789478450.924328:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1876403964430976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478450.924333:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964432512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789478450.924362:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789478450.924395:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1876403964430976:12345-0@lo:400:kworker.0 Request processed in 459us (5542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478450.924403:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789478450.924423:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964432512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478450.924429:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789478450.924437:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789478450.924441:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964432384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789478450.924476:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789478450.924485:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964432512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789478450.924522:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964432384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789478450.924640:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964432384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 202us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478450.924657:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1789478450.924726:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789478450.924731:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789478450.924734:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789478450.924736:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789478450.924773:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03785f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964430976:0@lo:400:kworker.0 00010000:00080000:3.0:1789478450.924789:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03784700 x1876403964431488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478450.924798:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964431488:0@lo:400:kworker.0 00010000:00080000:3.0:1789478450.924809:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03786300 x1876403964432000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478450.924817:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964432000:0@lo:400:kworker.0 00000100:00100000:3.0:1789478450.924829:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964430848:0@lo:400:kworker.0 00000100:00100000:3.0:1789478450.924840:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964431360:0@lo:400:kworker.0 00000100:00100000:3.0:1789478450.924850:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876403964431872:0@lo:400:kworker.0 00000100:00100000:3.0:1789478450.924882:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964431104:0@lo:400:kworker.0 00010000:00080000:3.0:1789478450.924893:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03785180 x1876403964431616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478450.924920:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964431616:0@lo:400:kworker.0 00010000:00080000:3.0:1789478450.924934:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03784e00 x1876403964432128/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478450.924943:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964432128:0@lo:400:kworker.0 00000100:00100000:3.0:1789478450.925007:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03785500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964430720:0@lo:400:kworker.0 00000100:00100000:3.0:1789478450.925019:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03787100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876403964431232:0@lo:400:kworker.0 00010000:00080000:3.0:1789478450.925030:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03787800 x1876403964431744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478450.925038:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03787800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964431744:0@lo:400:kworker.0 00010000:00080000:3.0:1789478450.925049:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03784a80 x1876403964432256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478450.925062:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964432256:0@lo:400:kworker.0 00000100:00100000:3.0:1789478451.428936:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789478451.428963:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964432640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789478451.429042:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478451.429098:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964432640 00000100:00100000:3.0:1789478451.429105:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964432640 00000100:00100000:3.0:1789478451.429166:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789478451.429177:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964432640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789478451.429215:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478451.429276:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964432640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478451.429300:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1789478451.429355:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40ed4700 x1876403964432640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478451.429376:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964432640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789478451.430088:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789478451.430101:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964432768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789478451.430145:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478451.430276:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964432768 00000100:00100000:0.0:1789478451.430282:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964432768 00000100:00100000:0.0:1789478451.430332:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789478451.430341:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03674000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964432768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789478451.430358:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478451.430400:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03674000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964432768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478451.430407:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1789478451.430435:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb035eb480 x1876403964432768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478451.430450:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964432768:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789478451.767050:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478452.772976:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478453.809997:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478453.993916:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964432896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789478453.993982:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478453.996436:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964432896 00000100:00100000:0.0:1789478453.996452:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964432896 00000100:00100000:0.0:1789478453.996537:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789478453.996560:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964432896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789478453.996613:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478453.996699:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964432896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (2716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478453.996706:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1789478453.996822:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789478453.996854:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb035eb480 x1876403964432896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478453.996873:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964432896:0@lo:13:osp-pre-0-0.0 00000020:00000004:3.0:1789478454.081422:0:12888:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789478454.083345:0:12888:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789478454.409360:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478454.409825:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478454.409890:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478454.409956:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478454.409996:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478454.410063:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478454.410122:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478454.410188:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945487488 00000100:00100000:1.0:1789478454.410197:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945487488 00000100:00100000:1.0:1789478454.410271:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 301 00000100:00100000:1.0:1789478454.410284:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2397:x1876403945487488:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478454.410348:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2397:x1876403945487488:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 68us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478454.410358:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 301 00000100:00100000:1.0:1789478454.410566:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945488128 00000100:00100000:1.0:1789478454.410571:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945488128 00000100:00100000:1.0:1789478454.410652:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945488256 00000100:00100000:1.0:1789478454.410656:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945488256 00000100:00100000:1.0:1789478454.410683:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 22 00000100:00100000:1.0:1789478454.410692:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2394:x1876403945488128:12345-192.168.206.11@tcp:9:kworker.0 00000020:00000080:1.0:1789478454.410712:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215ec2 00000100:00080000:1.0:1789478454.410723:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8ebb03681800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789478454.410764:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789478454.410930:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945487744 00000100:00100000:0.0:1789478454.410940:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945487744 00000100:00100000:1.0:1789478454.410949:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+2:2394:x1876403945488128:12345-192.168.206.11@tcp:9:kworker.0 Request processed in 257us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478454.410958:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 22 00000100:00100000:0.0:1789478454.410966:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945488000 00000100:00100000:0.0:1789478454.410970:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945488000 00000100:00100000:1.0:1789478454.410979:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 23 00000100:00100000:0.0:1789478454.410986:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945487616 00000100:00100000:0.0:1789478454.410990:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945487616 00000100:00100000:0.0:1789478454.411002:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945487872 00000100:00100000:0.0:1789478454.411004:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945487872 00000100:00100000:1.0:1789478454.411016:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2394:x1876403945488256:12345-192.168.206.11@tcp:9:kworker.0 00000100:00100000:0.0:1789478454.411019:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 134 00000100:00100000:0.0:1789478454.411030:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945487744:12345-192.168.206.11@tcp:400:kworker.0 00000020:00000080:1.0:1789478454.411035:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215ec9 00000100:00080000:1.0:1789478454.411043:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8ebb03681000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789478454.411066:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945487744:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 36us (1242us total) trans 0 rc 0/0 00000001:00000004:1.0:1789478454.411072:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789478454.411074:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 134 00000100:00100000:0.0:1789478454.411090:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 135 00000100:00100000:0.0:1789478454.411097:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2397:x1876403945488000:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478454.411119:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2397:x1876403945488000:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 23us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478454.411126:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 135 00000100:00100000:0.0:1789478454.411138:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 136 00000100:00100000:0.0:1789478454.411143:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2397:x1876403945487616:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478454.411160:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2397:x1876403945487616:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 17us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478454.411166:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 136 00000100:00100000:0.0:1789478454.411175:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 137 00000100:00100000:0.0:1789478454.411181:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2397:x1876403945487872:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478454.411203:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2397:x1876403945487872:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 22us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478454.411214:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 137 00010000:00010000:0.0:1789478454.411237:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478454.411317:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+2:2394:x1876403945488256:12345-192.168.206.11@tcp:9:kworker.0 Request processed in 321us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478454.411326:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 23 00010000:00010000:1.0:1789478454.411779:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789478454.412317:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789478454.412323:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789478454.412326:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789478454.412328:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789478454.501190:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964433024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789478454.501262:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478454.501409:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964433024 00000100:00100000:3.0:1789478454.501418:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964433024 00000100:00100000:3.0:1789478454.501484:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789478454.501493:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964433024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789478454.501513:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478454.501558:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964433024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478454.501565:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1789478454.502118:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789478454.502154:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb035e8700 x1876403964433024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478454.502177:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964433024:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789478454.822376:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478455.847441:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478456.037086:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964433152:0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.037166:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478456.037210:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964433664:0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.037237:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478456.037258:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964434176:0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.037280:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478456.037297:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964434688:0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.037316:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478456.037338:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789478456.037344:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964433280:0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.037381:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478456.037398:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03787800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964433792:0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.037417:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478456.037432:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964434304:0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.037452:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478456.037478:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964433408:0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.037501:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478456.037517:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03787100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964433920:0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.037553:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478456.037563:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964434432:0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.037580:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478456.037591:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789478456.037616:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964433536:0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.037649:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478456.037665:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03785500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964434048:0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.037684:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478456.037713:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964434560:0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.037733:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478456.037763:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964433664 00000100:00100000:3.0:1789478456.037771:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964433664 00000100:00100000:3.0:1789478456.037802:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964433280 00000100:00100000:3.0:1789478456.037805:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964433280 00000100:00100000:3.0:1789478456.037816:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964433792 00000100:00100000:3.0:1789478456.037818:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964433792 00000100:00100000:3.0:1789478456.037836:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964434304 00000100:00100000:3.0:1789478456.037839:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964434304 00000100:00100000:3.0:1789478456.037859:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964433920 00000100:00100000:3.0:1789478456.037861:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964433920 00000100:00100000:3.0:1789478456.037870:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964434432 00000100:00100000:3.0:1789478456.037872:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964434432 00000100:00100000:3.0:1789478456.037885:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789478456.037892:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964433664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.037940:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964433664:12345-0@lo:400:kworker.0 Request processed in 48us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478456.037946:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789478456.037960:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789478456.037965:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964433280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.037989:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964433280:12345-0@lo:400:kworker.0 Request processed in 23us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478456.037994:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789478456.038004:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789478456.038009:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb034f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964433792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.038029:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb034f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964433792:12345-0@lo:400:kworker.0 Request processed in 21us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478456.038035:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789478456.038044:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789478456.038048:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb034f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964434304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.038069:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb034f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964434304:12345-0@lo:400:kworker.0 Request processed in 20us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478456.038073:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789478456.038082:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789478456.038087:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964433920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.038126:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964433920:12345-0@lo:400:kworker.0 Request processed in 38us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478456.038131:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789478456.038143:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789478456.038148:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964434432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.038174:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964434432:12345-0@lo:400:kworker.0 Request processed in 26us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478456.038179:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789478456.038195:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964434176 00000100:00100000:3.0:1789478456.038198:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964434176 00000100:00100000:3.0:1789478456.038214:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964434688 00000100:00100000:3.0:1789478456.038216:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964434688 00000100:00100000:3.0:1789478456.038224:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964434048 00000100:00100000:3.0:1789478456.038226:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964434048 00000100:00100000:3.0:1789478456.038234:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964434560 00000100:00100000:3.0:1789478456.038236:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964434560 00000100:00100000:3.0:1789478456.038244:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789478456.038249:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03786300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964434176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.038273:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03786300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964434176:12345-0@lo:400:kworker.0 Request processed in 24us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478456.038278:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789478456.038288:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789478456.038293:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964434688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.038317:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964434688:12345-0@lo:400:kworker.0 Request processed in 24us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478456.038323:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789478456.038332:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789478456.038344:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964434048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.038373:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964434048:12345-0@lo:400:kworker.0 Request processed in 30us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478456.038378:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789478456.038389:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789478456.038395:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964434560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.038418:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964434560:12345-0@lo:400:kworker.0 Request processed in 23us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478456.038423:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1789478456.038447:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789478456.038451:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789478456.038453:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789478456.038455:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789478456.038479:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03785500 x1876403964434048/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478456.038492:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03785500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964434048:0@lo:400:kworker.0 00010000:00080000:3.0:1789478456.038501:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03786d80 x1876403964434560/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478456.038509:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964434560:0@lo:400:kworker.0 00010000:00080000:3.0:1789478456.038517:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03787100 x1876403964433920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478456.038525:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03787100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964433920:0@lo:400:kworker.0 00010000:00080000:3.0:1789478456.038533:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03785c00 x1876403964434432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478456.038540:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964434432:0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.038574:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964433280:0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.038581:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03787800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964433792:0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.038589:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964434304:0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.038615:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964433664:0@lo:400:kworker.0 00010000:00080000:3.0:1789478456.038634:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03784e00 x1876403964434176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478456.038642:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964434176:0@lo:400:kworker.0 00010000:00080000:3.0:1789478456.038650:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03787480 x1876403964434688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478456.038658:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964434688:0@lo:400:kworker.0 00000100:00100000:0.0:1789478456.039293:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964433408 00000100:00100000:0.0:1789478456.039298:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964433408 00000100:00100000:0.0:1789478456.039323:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964433536 00000100:00100000:0.0:1789478456.039326:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964433536 00000100:00100000:0.0:1789478456.039340:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789478456.039347:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb034fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964433408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478456.039389:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb034fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964433408:12345-0@lo:400:kworker.0 Request processed in 43us (1886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478456.039395:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789478456.039407:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789478456.039413:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964433536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478456.039439:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964433536:12345-0@lo:400:kworker.0 Request processed in 26us (1789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478456.039444:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789478456.039470:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964433536:0@lo:400:kworker.0 00000100:00100000:0.0:1789478456.039480:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964433408:0@lo:400:kworker.0 00000100:00100000:0.0:1789478456.039496:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789478456.039502:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964434816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789478456.039539:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478456.039564:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964434816 00000100:00100000:0.0:1789478456.039568:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964434816 00000100:00100000:0.0:1789478456.039582:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789478456.039612:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964434816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789478456.039648:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789478456.039684:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964434816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478456.039689:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789478456.039729:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964434816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789478456.042390:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964433152 00000100:00100000:0.0:1789478456.042403:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964433152 00000100:00100000:0.0:1789478456.042466:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1789478456.042476:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3645:x1876403964433152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478456.042563:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3645:x1876403964433152:12345-0@lo:400:kworker.0 Request processed in 89us (5397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478456.042570:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1789478456.042649:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964433152:0@lo:400:kworker.0 00000100:00100000:3.0:1789478456.049976:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789478456.049999:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964434944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789478456.050067:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478456.051497:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964434944 00000100:00100000:2.0:1789478456.051507:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964434944 00000100:00100000:2.0:1789478456.051573:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789478456.051584:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964434944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789478456.051648:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789478456.051821:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964434944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 239us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478456.051841:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789478456.051894:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964434944:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789478456.548787:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964435072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789478456.548853:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478456.549007:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964435072 00000100:00100000:0.0:1789478456.549014:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964435072 00000100:00100000:0.0:1789478456.549066:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789478456.549076:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964435072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789478456.549102:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478456.549161:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964435072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478456.549168:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1789478456.549279:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb035e9180 x1876403964435072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478456.549296:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964435072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789478456.549682:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789478456.549693:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964435200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789478456.549722:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478456.549775:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964435200 00000100:00100000:1.0:1789478456.549779:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964435200 00000100:00100000:1.0:1789478456.549812:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789478456.549820:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964435200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789478456.549831:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789478456.549871:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964435200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478456.549877:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1789478456.550003:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40ff9180 x1876403964435200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478456.550017:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964435200:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789478456.870524:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478457.893383:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789478458.025740:0:13032:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789478458.918052:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478459.109738:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789478459.109770:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964435328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789478459.109836:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478459.110314:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964435328 00000100:00100000:1.0:1789478459.110322:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964435328 00000100:00100000:1.0:1789478459.110380:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789478459.110391:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964435328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789478459.110418:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789478459.110475:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964435328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478459.110481:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1789478459.110843:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789478459.112625:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb035ead80 x1876403964435328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478459.112654:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964435328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789478459.522659:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478459.522682:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478459.522717:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478459.522883:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945488512 00000100:00100000:3.0:1789478459.522892:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945488512 00000100:00100000:3.0:1789478459.522961:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945488768 00000100:00100000:3.0:1789478459.522992:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945488768 00000100:00100000:3.0:1789478459.523044:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 144 00000100:00100000:3.0:1789478459.523075:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2395:x1876403945488512:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478459.523139:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 145 00000100:00100000:0.0:1789478459.523148:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2395:x1876403945488768:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478459.523165:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2395:x1876403945488512:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 113us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478459.523171:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2395:x1876403945488768:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 26us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478459.523172:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 144 00000100:00080000:2.0:1789478459.523263:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789478459.524688:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 145 00000100:00100000:0.0:1789478459.524727:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945488384 00000100:00100000:0.0:1789478459.524733:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945488384 00000100:00100000:0.0:1789478459.525519:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 303 00000100:00100000:0.0:1789478459.525531:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2395:x1876403945488384:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478459.525631:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2395:x1876403945488384:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 102us (2911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478459.525638:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 303 00000100:00100000:3.0:1789478459.529557:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478459.529587:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478459.529644:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945488640 00000100:00100000:3.0:1789478459.529652:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945488640 00000100:00100000:3.0:1789478459.529696:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945488896 00000100:00100000:3.0:1789478459.529698:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945488896 00000100:00100000:3.0:1789478459.529718:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 146 00000100:00100000:3.0:1789478459.529726:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945488640:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478459.529785:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945488640:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 59us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478459.529792:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 146 00000100:00100000:3.0:1789478459.529806:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 147 00000100:00100000:3.0:1789478459.529812:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2395:x1876403945488896:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478459.529844:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2395:x1876403945488896:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 32us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478459.529850:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 147 00000100:00080000:3.0:1789478459.529866:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789478459.626789:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964435456:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789478459.626849:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478459.626947:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964435456 00000100:00100000:0.0:1789478459.626955:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964435456 00000100:00080000:3.0:1789478459.627010:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789478459.627015:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789478459.627025:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964435456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789478459.627046:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478459.627091:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964435456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478459.627098:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1789478459.627161:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb035ead80 x1876403964435456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478459.627196:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964435456:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1789478459.632017:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6a1d5e8d-e61d-452f-a651-9ee87fa9267a 00000020:00000080:1.0:1789478459.632026:0:8425:0:(genops.c:885:class_export_put()) final put ffff8ebb03685800/6a1d5e8d-e61d-452f-a651-9ee87fa9267a 00000020:00000080:2.0:1789478459.632127:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebb03685800/6a1d5e8d-e61d-452f-a651-9ee87fa9267a for lustre-OST0000 00000020:00000080:2.0:1789478459.632186:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebb03681800 for lustre-OST0000 00000001:00100000:0.0:1789478459.635226:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6a1d5e8d-e61d-452f-a651-9ee87fa9267a 00000020:00000080:0.0:1789478459.635235:0:9510:0:(genops.c:885:class_export_put()) final put ffff8ebb03686000/6a1d5e8d-e61d-452f-a651-9ee87fa9267a 00000020:00000080:1.0:1789478459.635340:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebb03686000/6a1d5e8d-e61d-452f-a651-9ee87fa9267a for lustre-OST0001 00000020:00000080:1.0:1789478459.635392:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebb03681000 for lustre-OST0001 00010000:00010000:0.0:1789478459.947004:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789478460.748442:0:13180:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd8560cf40 20000000:00000080:2.0:1789478460.748458:0:13180:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ebb0336dc00 uarg=0000000000000000 20000000:01000000:2.0:1789478460.748574:0:13180:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789478460.748583:0:13180:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789478460.748587:0:13180:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789478460.751153:0:13181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789478460.751243:0:13180:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789478460.755386:0:13180:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789478460.755410:0:13180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ebc34f77e00/0x8ebaae74e8215ed0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.755426:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc35b67400/0x8ebaae74e8215e60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b71ce expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.755431:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc34f76400/0x8ebaae74e8215e6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215e67 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.755436:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc40fcf600/0x8ebaae74e8215e7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215e75 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.755439:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc40fce600/0x8ebaae74e8215e8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215e83 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.755443:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebb035fce00/0x8ebaae74e8215e98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215e91 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.755447:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc35b67a00/0x8ebaae74e8215ead lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b720d expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.755451:0:13180:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ebc34f77e00/0x8ebaae74e8215ed0 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.755484:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc35b67a00/0x8ebaae74e8215ead lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b720d expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.755500:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ebc35b67a00/0x8ebaae74e8215ead lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b720d expref: 12 pid: 6512 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478460.755524:0:13180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c963800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1876403964435584:192.168.206.11@tcp:104: 00010000:00010000:2.0:1789478460.755643:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebb035fce00/0x8ebaae74e8215e98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215e91 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.755652:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebb035fce00/0x8ebaae74e8215e98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215e91 expref: 23 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478460.755661:0:13180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c960e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1876403964435712:0@lo:104: 00000100:00100000:2.0:1789478460.755698:0:13180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789478460.755735:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc40fce600/0x8ebaae74e8215e8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215e83 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.755744:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc40fce600/0x8ebaae74e8215e8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215e83 expref: 23 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478460.755752:0:13180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c962680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1876403964435840:0@lo:104: 00000100:00100000:2.0:1789478460.755772:0:13180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478460.755799:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964435712 00000100:00100000:2.0:1789478460.755806:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964435712 00000100:00100000:2.0:1789478460.755840:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964435840 00000100:00100000:2.0:1789478460.755844:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964435840 00000100:00100000:2.0:1789478460.755857:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789478460.755866:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c960a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+4:13180:x1876403964435712:12345-0@lo:104: 00010000:00010000:2.0:1789478460.755877:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e8215e91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215e98 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.755927:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789478460.755934:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c960a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+4:13180:x1876403964435712:12345-0@lo:104: Request processed in 69us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478460.755947:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789478460.755966:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789478460.755973:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09124a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+3:13180:x1876403964435840:12345-0@lo:104: 00010000:00010000:2.0:1789478460.755982:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e8215e83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215e8a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.756020:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789478460.756025:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09124a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+3:13180:x1876403964435840:12345-0@lo:104: Request processed in 54us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478460.756032:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1789478460.756051:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789478460.756052:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478460.756056:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e8215e91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215e98 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478460.756057:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e8215e83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215e8a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.756063:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fc400 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:2.0:1789478460.756067:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e8215e91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215e98 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.756076:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e8215e91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215e98 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789478460.756083:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e8215e91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215e98 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478460.756089:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789478460.756121:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e8215e91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215e98 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.756128:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789478460.756156:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e8215e91 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215e98 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.756163:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e8215e91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215e98 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.756173:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478460.756175:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478460.756177:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478460.756188:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964435968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789478460.756214:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789478460.756251:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd800 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:3.0:1789478460.756255:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e8215e83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215e8a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478460.756257:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964435968 00000100:00100000:2.0:1789478460.756262:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964435968 00010000:00010000:3.0:1789478460.756268:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e8215e83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215e8a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789478460.756276:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e8215e83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215e8a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.756281:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebb035fce00/0x8ebaae74e8215e98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215e91 expref: 24 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478460.756283:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1789478460.756308:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789478460.756314:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09126680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3648:x1876403964435968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789478460.756321:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478460.756324:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebb035fce00/0x8ebaae74e8215e98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215e91 expref: 24 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.756330:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebb035fce00/0x8ebaae74e8215e98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215e91 expref: 24 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.756340:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478460.756359:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09126680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3648:x1876403964435968:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478460.756362:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789478460.756382:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964435968:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789478460.756409:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc40fcf600/0x8ebaae74e8215e7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215e75 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.756415:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc40fcf600/0x8ebaae74e8215e7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215e75 expref: 23 pid: 6511 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478460.756421:0:13180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09124380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1876403964436096:0@lo:104: 00000100:00100000:2.0:1789478460.756443:0:13180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789478460.756465:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc34f76400/0x8ebaae74e8215e6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215e67 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.756473:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc34f76400/0x8ebaae74e8215e6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215e67 expref: 23 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478460.756481:0:13180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1876403964436224:0@lo:104: 00000100:00100000:2.0:1789478460.756501:0:13180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478460.756520:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964436096 00000100:00100000:2.0:1789478460.756524:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964436096 00000100:00100000:2.0:1789478460.756538:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964436224 00000100:00100000:2.0:1789478460.756540:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964436224 00000100:00100000:2.0:1789478460.756554:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789478460.756559:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+4:13180:x1876403964436096:12345-0@lo:104: 00010000:00010000:2.0:1789478460.756567:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66600/0x8ebaae74e8215e75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215e7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.756641:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789478460.756647:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+4:13180:x1876403964436096:12345-0@lo:104: Request processed in 88us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478460.756654:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789478460.756674:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789478460.756680:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+3:13180:x1876403964436224:12345-0@lo:104: 00010000:00010000:2.0:1789478460.756689:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e8215e67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215e6e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.756723:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789478460.756728:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+3:13180:x1876403964436224:12345-0@lo:104: Request processed in 48us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478460.756733:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1789478460.756746:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789478460.756750:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66600/0x8ebaae74e8215e75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215e7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.756756:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b66600 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:2.0:1789478460.756760:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66600/0x8ebaae74e8215e75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215e7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.756767:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66600/0x8ebaae74e8215e75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215e7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789478460.756773:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66600/0x8ebaae74e8215e75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215e7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478460.756778:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789478460.759066:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66600/0x8ebaae74e8215e75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215e7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.759080:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789478460.759101:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66600/0x8ebaae74e8215e75 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215e7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.759121:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66600/0x8ebaae74e8215e75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215e7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.759136:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478460.759140:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e8215e67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215e6e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.759147:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fc000 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:2.0:1789478460.759150:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e8215e67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215e6e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.759159:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e8215e67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215e6e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789478460.759164:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e8215e67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215e6e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478460.759169:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789478460.759184:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e8215e67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215e6e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.759189:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789478460.759195:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e8215e67 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215e6e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.759201:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e8215e67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215e6e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.759209:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478460.759215:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478460.759217:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478460.759233:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964436352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789478460.759284:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478460.759328:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789478460.759334:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964436480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789478460.759354:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789478460.759397:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc35b67400/0x8ebaae74e8215e60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b71ce expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.759409:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ebc35b67400/0x8ebaae74e8215e60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b71ce expref: 12 pid: 6510 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478460.759419:0:13180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1876403964436608:192.168.206.11@tcp:104: 00000100:00100000:2.0:1789478460.759462:0:13180:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34de19c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789478460.759498:0:13180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebb035fce00/0x8ebaae74e8215e98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215e91 expref: 23 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478460.759509:0:13180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c960e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1876403964435712:0@lo:104: 00000100:00100000:2.0:1789478460.759519:0:13180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c962680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1876403964435840:0@lo:104: 00000100:00100000:2.0:1789478460.759527:0:13180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09124380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1876403964436096:0@lo:104: 00000100:00100000:2.0:1789478460.759534:0:13180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1876403964436224:0@lo:104: 00010000:00010000:3.0:1789478460.759732:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e8215e83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215e8a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478460.759740:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789478460.759755:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e8215e83 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215e8a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478460.759762:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e8215e83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215e8a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478460.759774:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478460.759776:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478460.759778:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478460.759788:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964436736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789478460.759827:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478460.759862:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964436352 00000100:00100000:3.0:1789478460.759868:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964436352 00010000:00010000:3.0:1789478460.759892:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc40fcf600/0x8ebaae74e8215e7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215e75 expref: 23 pid: 6511 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478460.759937:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964436480 00000100:00100000:3.0:1789478460.759941:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964436480 00010000:00010000:3.0:1789478460.759956:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc34f76400/0x8ebaae74e8215e6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215e67 expref: 24 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478460.759969:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964436736 00000100:00100000:3.0:1789478460.759972:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964436736 00010000:00010000:3.0:1789478460.759982:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc40fce600/0x8ebaae74e8215e8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215e83 expref: 25 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478460.759996:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789478460.760006:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+25:3645:x1876403964436352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789478460.760017:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478460.760022:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc40fcf600/0x8ebaae74e8215e7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215e75 expref: 25 pid: 6511 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478460.760030:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc40fcf600/0x8ebaae74e8215e7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215e75 expref: 25 pid: 6511 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478460.760042:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc40fcf600/0x8ebaae74e8215e7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215e75 expref: 25 pid: 6511 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478460.760054:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478460.760085:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3645:x1876403964436352:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478460.760092:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789478460.760108:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789478460.760113:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+23:3645:x1876403964436480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789478460.760128:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478460.760132:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc34f76400/0x8ebaae74e8215e6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215e67 expref: 23 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478460.760140:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc34f76400/0x8ebaae74e8215e6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215e67 expref: 23 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478460.760149:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc34f76400/0x8ebaae74e8215e6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215e67 expref: 23 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478460.760158:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478460.760179:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+22:3645:x1876403964436480:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478460.760184:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789478460.760197:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789478460.760202:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03784e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+21:3647:x1876403964436736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789478460.760209:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478460.760213:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc40fce600/0x8ebaae74e8215e8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215e83 expref: 21 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478460.760220:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc40fce600/0x8ebaae74e8215e8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215e83 expref: 21 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478460.760240:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc40fce600/0x8ebaae74e8215e8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215e83 expref: 21 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478460.760249:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478460.760274:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03784e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c56e5039-4535-4d8a-bd01-962355b55f9c+20:3647:x1876403964436736:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478460.760287:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789478460.760392:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964436480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789478460.760400:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964436352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789478460.760425:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964436736:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789478460.761711:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478460.767108:0:13180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c963800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1876403964435584:192.168.206.11@tcp:104: 00000100:00100000:3.0:1789478460.768507:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478460.769363:0:13180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1876403964436608:192.168.206.11@tcp:104: 00010000:00010000:2.0:1789478460.769407:0:13180:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ebc34f77e00/0x8ebaae74e8215ed0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478460.769540:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478460.770725:0:10392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945489024 00000100:00100000:1.0:1789478460.770788:0:10392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945489024 00010000:00010000:1.0:1789478460.770972:0:10392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc35b67a00/0x8ebaae74e8215ead lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b720d expref: 13 pid: 6512 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478460.770999:0:10392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945489152 00000100:00100000:1.0:1789478460.771002:0:10392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945489152 00010000:00010000:1.0:1789478460.771013:0:10392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc35b67400/0x8ebaae74e8215e60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b71ce expref: 14 pid: 6510 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478460.771073:0:10392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 44 00000100:00100000:1.0:1789478460.771090:0:10392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03787480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+14:2396:x1876403945489024:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789478460.771297:0:10392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478460.771305:0:10392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc35b67a00/0x8ebaae74e8215ead lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b720d expref: 14 pid: 6512 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478460.771316:0:10392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc35b67a00/0x8ebaae74e8215ead lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b720d expref: 14 pid: 6512 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478460.771333:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc35b67a00/0x8ebaae74e8215ead lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b720d expref: 14 pid: 6512 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478460.771346:0:10392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478460.771411:0:10392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03787480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2396:x1876403945489024:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 321us (2908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478460.771419:0:10392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 44 00000100:00100000:1.0:1789478460.771437:0:10392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 45 00000100:00100000:1.0:1789478460.771444:0:10392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08340050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+12:2396:x1876403945489152:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789478460.771452:0:10392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478460.771457:0:10392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc35b67400/0x8ebaae74e8215e60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b71ce expref: 12 pid: 6510 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478460.771466:0:10392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc35b67400/0x8ebaae74e8215e60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b71ce expref: 12 pid: 6510 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478460.771475:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc35b67400/0x8ebaae74e8215e60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b71ce expref: 12 pid: 6510 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478460.771486:0:10392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ebc34f77e00/0x8ebaae74e8215ed0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478460.771493:0:10392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc34f77e00/0x8ebaae74e8215ed0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478460.771507:0:10392:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc34f77e00/0x8ebaae74e8215ed0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478460.771514:0:10392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc34f77e00/0x8ebaae74e8215ed0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478460.771520:0:10392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ebc34f77e00/0x8ebaae74e8215ed0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478460.771527:0:10392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ebc34f77e00/0x8ebaae74e8215ed0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478460.771539:0:10392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77e00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:1.0:1789478460.771542:0:10392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ebc34f77e00/0x8ebaae74e8215ed0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478460.771550:0:10392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ebc34f77e00/0x8ebaae74e8215ed0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478460.771564:0:10392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ebc34f77e00/0x8ebaae74e8215ed0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478460.771573:0:10392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478460.771618:0:10392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08340050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+11:2396:x1876403945489152:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 149us (2053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478460.771634:0:10392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 45 00010000:00010000:3.0:1789478460.774029:0:13180:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ebc34f77e00/0x8ebaae74e8215ed0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478460.774044:0:13180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ebc34f77e00/0x8ebaae74e8215ed0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478460.774051:0:13180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc34f77e00/0x8ebaae74e8215ed0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478460.964698:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478461.158771:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789478461.158808:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964436864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789478461.158873:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478461.158925:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964436864 00000100:00100000:3.0:1789478461.158932:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964436864 00000100:00100000:3.0:1789478461.158972:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789478461.158981:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964436864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789478461.159012:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789478461.159054:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964436864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478461.159062:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789478461.159116:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964436864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789478461.159451:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876403964437120:0@lo:400:kworker.0 00000100:00100000:1.0:1789478461.159482:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478461.159511:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876403964437632:0@lo:400:kworker.0 00000100:00100000:1.0:1789478461.159530:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478461.159543:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876403964438144:0@lo:400:kworker.0 00000100:00100000:1.0:1789478461.159560:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478461.159573:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789478461.159578:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964436992:0@lo:400:kworker.0 00000100:00100000:1.0:1789478461.159630:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478461.159651:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876403964437504:0@lo:400:kworker.0 00000100:00100000:1.0:1789478461.159671:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478461.159683:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876403964438016:0@lo:400:kworker.0 00000100:00100000:1.0:1789478461.159708:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478461.162354:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964437120 00000100:00100000:3.0:1789478461.162367:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964437120 00000100:00100000:3.0:1789478461.162409:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964437632 00000100:00100000:3.0:1789478461.162413:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964437632 00000100:00100000:3.0:1789478461.162449:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964438144 00000100:00100000:3.0:1789478461.162453:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964438144 00000100:00100000:3.0:1789478461.162466:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964437504 00000100:00100000:3.0:1789478461.162469:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964437504 00000100:00100000:3.0:1789478461.162480:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964438016 00000100:00100000:3.0:1789478461.162482:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964438016 00000100:00100000:3.0:1789478461.162498:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789478461.162507:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876403964437120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478461.162586:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876403964437120:12345-0@lo:400:kworker.0 Request processed in 80us (3102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478461.162628:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789478461.162644:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789478461.162650:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876403964437632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478461.162678:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876403964437632:12345-0@lo:400:kworker.0 Request processed in 30us (3147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478461.162685:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789478461.162694:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789478461.162700:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876403964438144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478461.162725:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876403964438144:12345-0@lo:400:kworker.0 Request processed in 26us (3165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478461.162731:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789478461.162741:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789478461.162746:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876403964437504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478461.162785:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876403964437504:12345-0@lo:400:kworker.0 Request processed in 39us (3113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478461.162792:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789478461.162804:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789478461.162809:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876403964438016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478461.162833:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876403964438016:12345-0@lo:400:kworker.0 Request processed in 24us (3124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478461.162839:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789478461.162860:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964436992 00000100:00100000:3.0:1789478461.162863:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964436992 00000100:00100000:3.0:1789478461.162890:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789478461.162895:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+20:3646:x1876403964436992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478461.162922:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+20:3646:x1876403964436992:12345-0@lo:400:kworker.0 Request processed in 27us (3291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478461.162928:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789478461.162967:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964437248:0@lo:400:kworker.0 00000100:00100000:3.0:1789478461.162997:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478461.163023:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964437760:0@lo:400:kworker.0 00000100:00100000:3.0:1789478461.163045:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478461.163062:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964438272:0@lo:400:kworker.0 00000100:00100000:3.0:1789478461.163081:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478461.163108:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789478461.163116:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964437376:0@lo:400:kworker.0 00000100:00100000:3.0:1789478461.163138:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478461.163154:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964437888:0@lo:400:kworker.0 00000100:00100000:3.0:1789478461.163182:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478461.163198:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964438400:0@lo:400:kworker.0 00000100:00100000:3.0:1789478461.163219:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478461.163244:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964437248 00000100:00100000:3.0:1789478461.163247:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964437248 00000100:00100000:3.0:1789478461.163271:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789478461.163277:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964437248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478461.163309:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964437248:12345-0@lo:400:kworker.0 Request processed in 32us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478461.163315:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789478461.163330:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964437760 00000100:00100000:3.0:1789478461.163333:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964437760 00000100:00100000:3.0:1789478461.163350:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964438272 00000100:00100000:3.0:1789478461.163352:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964438272 00000100:00100000:3.0:1789478461.163362:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964437888 00000100:00100000:3.0:1789478461.163364:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964437888 00000100:00100000:3.0:1789478461.163375:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964438400 00000100:00100000:3.0:1789478461.163377:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964438400 00000100:00100000:3.0:1789478461.163388:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789478461.163393:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03787800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964437760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478461.163420:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03787800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964437760:12345-0@lo:400:kworker.0 Request processed in 26us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478461.163426:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789478461.163437:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789478461.163442:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964438272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478461.163466:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964438272:12345-0@lo:400:kworker.0 Request processed in 23us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478461.163471:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789478461.163489:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789478461.163495:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964437888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478461.163522:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964437888:12345-0@lo:400:kworker.0 Request processed in 27us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478461.163528:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789478461.163537:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789478461.163542:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964438400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478461.163564:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964438400:12345-0@lo:400:kworker.0 Request processed in 22us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478461.163569:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789478461.163640:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964436992:0@lo:400:kworker.0 00000100:00100000:3.0:1789478461.163653:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876403964437504:0@lo:400:kworker.0 00000100:00100000:3.0:1789478461.163662:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876403964438016:0@lo:400:kworker.0 00000100:00100000:3.0:1789478461.163671:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876403964437120:0@lo:400:kworker.0 00010000:00080000:3.0:1789478461.163683:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c1d500 x1876403964437632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478461.163693:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876403964437632:0@lo:400:kworker.0 00010000:00080000:3.0:1789478461.163702:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c1ca80 x1876403964438144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478461.163710:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876403964438144:0@lo:400:kworker.0 00010000:00080000:3.0:1789478461.163742:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c1ed80 x1876403964437888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478461.163761:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964437888:0@lo:400:kworker.0 00010000:00080000:3.0:1789478461.163771:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c1c700 x1876403964438400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478461.163778:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964438400:0@lo:400:kworker.0 00000100:00100000:3.0:1789478461.163785:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964437248:0@lo:400:kworker.0 00010000:00080000:3.0:1789478461.163792:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c1c380 x1876403964437760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478461.163799:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964437760:0@lo:400:kworker.0 00010000:00080000:3.0:1789478461.163805:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c1d880 x1876403964438272/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478461.163812:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964438272:0@lo:400:kworker.0 00000100:00100000:3.0:1789478461.163832:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964437376 00000100:00100000:3.0:1789478461.163835:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964437376 00000100:00100000:3.0:1789478461.163853:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789478461.163858:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964437376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478461.163886:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964437376:12345-0@lo:400:kworker.0 Request processed in 28us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478461.163892:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789478461.163913:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964437376:0@lo:400:kworker.0 00000100:00080000:1.0:1789478461.164760:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789478461.164766:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789478461.164769:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789478461.164771:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789478461.168529:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789478461.168549:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964438528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478461.168634:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478461.169241:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964438528 00000100:00100000:2.0:1789478461.169249:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964438528 00000100:00100000:2.0:1789478461.169313:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789478461.169323:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964438528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789478461.169355:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789478461.169404:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964438528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478461.169410:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789478461.169451:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964438528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789478461.671144:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964438656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789478461.671226:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478461.671382:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964438656 00000100:00100000:1.0:1789478461.671390:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964438656 00000100:00100000:1.0:1789478461.671446:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789478461.671455:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964438656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789478461.671481:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789478461.671535:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964438656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478461.671542:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789478461.672065:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964438784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789478461.672098:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478461.672305:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964438784 00000100:00100000:0.0:1789478461.672321:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964438784 00000100:00100000:0.0:1789478461.672357:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789478461.672365:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964438784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789478461.672378:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478461.672421:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964438784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478461.672428:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1789478461.672535:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb035e9180 x1876403964438784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478461.672553:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964438784:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789478461.673303:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40ffbb80 x1876403964438656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478461.673319:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964438656:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789478461.997473:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789478462.118361:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789478462.118368:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebc3f6c1800 from 7 10000000:01000000:2.0:1789478462.118373:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789478462.118414:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215ed7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478462.118427:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215ed7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478462.118456:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215ed7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478462.118480:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964438912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789478462.118539:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478462.118571:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb027d19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478462.118948:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964438912 00000100:00100000:0.0:1789478462.118956:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964438912 00000100:00100000:0.0:1789478462.119011:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789478462.119020:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+20:6514:x1876403964438912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789478462.119033:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478462.119046:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc35b67400/0x8ebaae74e8215ede lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215ed7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478462.119067:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc35b67400/0x8ebaae74e8215ede lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215ed7 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478462.119078:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc35b67400/0x8ebaae74e8215ede lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215ed7 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478462.119086:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b67400, rc 0) 00000100:00100000:0.0:1789478462.119129:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964438912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478462.119136:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1789478462.119487:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964438912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789478462.119502:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215ed7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215ede expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478462.119512:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215ed7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215ede expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478462.119571:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964439040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789478462.119627:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478462.119649:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb027d19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478462.119743:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964439040 00000100:00100000:0.0:1789478462.119748:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964439040 00000100:00100000:0.0:1789478462.119790:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1789478462.119807:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964439040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789478462.119920:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964439040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478462.119927:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789478462.120093:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964439040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789478462.120124:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964439168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789478462.120162:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478462.120183:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb027d19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478462.120330:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964439168 00000100:00100000:1.0:1789478462.120334:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964439168 00000100:00100000:1.0:1789478462.120366:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789478462.120374:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964439168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789478462.120460:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964439168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478462.120467:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789478462.120537:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964439168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789478462.123390:0:13200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789478462.128369:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789478462.128398:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789478462.128409:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215ed7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215ede expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478462.128420:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215ed7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215ede expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478462.128430:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789478462.128433:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebc40e0d800 from 7 10000000:01000000:0.0:1789478462.128435:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789478462.128511:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67a00/0x8ebaae74e8215ee5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478462.128520:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67a00/0x8ebaae74e8215ee5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478462.128530:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67a00/0x8ebaae74e8215ee5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478462.128553:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964439296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789478462.128645:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478462.128686:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb025f8240 going to sleep for 11 seconds 00000100:00100000:2.0:1789478462.129963:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964439296 00000100:00100000:2.0:1789478462.129972:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964439296 00000100:00100000:2.0:1789478462.130031:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789478462.130040:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964439296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789478462.130053:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478462.130067:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc34f76c00/0x8ebaae74e8215eec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215ee5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478462.130089:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc34f76c00/0x8ebaae74e8215eec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215ee5 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478462.130099:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc34f76c00/0x8ebaae74e8215eec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215ee5 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478462.130107:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76c00, rc 0) 00000100:00100000:2.0:1789478462.130157:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964439296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478462.130164:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789478462.141362:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964439296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789478462.141392:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67a00/0x8ebaae74e8215ee5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215eec expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478462.141410:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67a00/0x8ebaae74e8215ee5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215eec expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478462.142004:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964439424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789478462.142057:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478462.142085:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb025f8240 going to sleep for 11 seconds 00000100:00100000:1.0:1789478462.143122:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964439424 00000100:00100000:1.0:1789478462.143132:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964439424 00000100:00100000:1.0:1789478462.143184:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1789478462.143205:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964439424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478462.143365:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964439424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478462.143373:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1789478462.144406:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964439424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789478462.144454:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964439552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789478462.144514:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478462.144545:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb025f8240 going to sleep for 11 seconds 00000100:00100000:0.0:1789478462.144561:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964439552 00000100:00100000:0.0:1789478462.144565:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964439552 00000100:00100000:0.0:1789478462.144629:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789478462.144637:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964439552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789478462.144721:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964439552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478462.144727:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789478462.147380:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964439552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789478462.149997:0:13201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789478462.153085:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789478462.153117:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789478462.153127:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67a00/0x8ebaae74e8215ee5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215eec expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478462.153140:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67a00/0x8ebaae74e8215ee5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215eec expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478462.153152:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789478462.153154:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebc34d64800 from 7 10000000:01000000:2.0:1789478462.153157:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789478462.153206:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e8215ef3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478462.153231:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e8215ef3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478462.153256:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e8215ef3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478462.153280:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964439680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789478462.153338:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478462.153372:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb027d1600 going to sleep for 11 seconds 00000100:00100000:0.0:1789478462.153862:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964439680 00000100:00100000:0.0:1789478462.153869:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964439680 00000100:00100000:0.0:1789478462.153909:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789478462.153917:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964439680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789478462.153929:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478462.153946:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc35b66600/0x8ebaae74e8215efa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215ef3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478462.153966:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc35b66600/0x8ebaae74e8215efa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215ef3 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478462.153975:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc35b66600/0x8ebaae74e8215efa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215ef3 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478462.153983:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b66600, rc 0) 00000100:00100000:0.0:1789478462.154023:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964439680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478462.154030:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1789478462.155404:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964439680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789478462.155424:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e8215ef3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215efa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478462.155435:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e8215ef3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215efa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478462.155503:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ff9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964439808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478462.155546:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478462.155572:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc10043c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789478462.155629:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964439808 00000100:00100000:1.0:1789478462.155634:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964439808 00000100:00100000:1.0:1789478462.155666:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1789478462.155674:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964439808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478462.155774:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964439808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478462.155781:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1789478462.155816:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ff9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964439808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478462.155844:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ff9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964439936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789478462.155880:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478462.155893:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc10043c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789478462.155903:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964439936 00000100:00100000:1.0:1789478462.155912:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964439936 00000100:00100000:1.0:1789478462.155933:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1789478462.155939:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964439936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789478462.156009:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964439936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478462.156016:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1789478462.156052:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ff9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964439936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789478462.159097:0:13203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789478462.159182:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789478462.159201:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789478462.159211:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e8215ef3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215efa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478462.159222:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e8215ef3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215efa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478462.159233:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789478462.159249:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebc0501d800 from 7 10000000:01000000:1.0:1789478462.159253:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789478462.159289:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce600/0x8ebaae74e8215f01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478462.159296:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce600/0x8ebaae74e8215f01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478462.159307:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce600/0x8ebaae74e8215f01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478462.159330:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ff9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964440064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789478462.159403:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478462.159429:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0273d000 going to sleep for 11 seconds 00000100:00100000:1.0:1789478462.159450:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964440064 00000100:00100000:1.0:1789478462.159455:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964440064 00000100:00100000:1.0:1789478462.159494:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789478462.159502:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964440064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789478462.159513:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478462.159525:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40fcf600/0x8ebaae74e8215f08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8215f01 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478462.159546:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40fcf600/0x8ebaae74e8215f08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8215f01 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478462.159556:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40fcf600/0x8ebaae74e8215f08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215f01 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478462.159564:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcf600, rc 0) 00000100:00100000:1.0:1789478462.159631:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:6514:x1876403964440064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478462.159638:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789478462.159679:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ff9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964440064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789478462.159690:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce600/0x8ebaae74e8215f01 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215f08 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478462.159699:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce600/0x8ebaae74e8215f01 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215f08 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478462.159753:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ff9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964440192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478462.159783:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478462.159817:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0273d000 going to sleep for 11 seconds 00000100:00100000:2.0:1789478462.161521:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964440192 00000100:00100000:2.0:1789478462.161532:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964440192 00000100:00100000:2.0:1789478462.161579:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789478462.161588:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:6514:x1876403964440192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789478462.161751:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:6514:x1876403964440192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (1965us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478462.161757:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789478462.161801:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ff9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964440192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789478462.161838:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964440320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789478462.161880:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478462.161905:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb027d1540 going to sleep for 11 seconds 00000100:00100000:2.0:1789478462.161917:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964440320 00000100:00100000:2.0:1789478462.161920:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964440320 00000100:00100000:2.0:1789478462.161942:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1789478462.161947:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:6514:x1876403964440320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789478462.162029:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:6514:x1876403964440320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478462.162042:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1789478462.162081:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964440320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789478462.162722:0:13204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789478462.162766:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789478462.162783:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789478462.162792:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce600/0x8ebaae74e8215f01 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215f08 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478462.162801:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce600/0x8ebaae74e8215f01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215f08 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478462.782541:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478462.788798:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945489280 00000100:00100000:1.0:1789478462.788813:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945489280 00000100:00100000:1.0:1789478462.788884:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 317 00000100:00100000:1.0:1789478462.788895:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+11:6164:x1876403945489280:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789478462.788911:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478462.788930:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40fce200/0x8ebaae74e8215f0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b723e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478462.788957:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40fce200/0x8ebaae74e8215f0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b723e expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478462.788969:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40fce200/0x8ebaae74e8215f0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b723e expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478462.788978:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fce200, rc 0) 00000100:00100000:1.0:1789478462.789035:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+12:6164:x1876403945489280:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 Request processed in 143us (6502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478462.789042:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 317 00000100:00100000:1.0:1789478462.797910:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478462.798059:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945489408 00000100:00100000:3.0:1789478462.798068:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945489408 00000100:00100000:3.0:1789478462.798128:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 318 00000100:00100000:3.0:1789478462.798138:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc272ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+12:6164:x1876403945489408:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789478462.798423:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc272ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+12:6164:x1876403945489408:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 Request processed in 285us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478462.798431:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 318 00000100:00100000:0.0:1789478462.803566:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478462.803788:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945489536 00000100:00100000:3.0:1789478462.803797:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945489536 00000100:00100000:3.0:1789478462.803896:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 319 00000100:00100000:3.0:1789478462.803906:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc272aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+12:6164:x1876403945489536:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789478462.804061:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc272aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+12:6164:x1876403945489536:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 Request processed in 149us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478462.804070:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 319 00000100:00100000:0.0:1789478462.823144:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478462.823670:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945489664 00000100:00100000:1.0:1789478462.823680:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945489664 00000100:00100000:1.0:1789478462.823731:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 320 00000100:00100000:1.0:1789478462.823742:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+12:6164:x1876403945489664:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789478462.823758:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478462.823774:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40fcf400/0x8ebaae74e8215f16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7245 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478462.823807:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40fcf400/0x8ebaae74e8215f16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7245 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478462.823819:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40fcf400/0x8ebaae74e8215f16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7245 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478462.823828:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcf400, rc 0) 00000100:00100000:1.0:1789478462.823888:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:6164:x1876403945489664:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 Request processed in 137us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478462.823896:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 320 00000100:00100000:2.0:1789478462.829052:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478462.829092:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945489792 00000100:00100000:3.0:1789478462.829103:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945489792 00000100:00100000:3.0:1789478462.829156:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 321 00000100:00100000:3.0:1789478462.829166:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:6164:x1876403945489792:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789478462.829314:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:6164:x1876403945489792:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 Request processed in 148us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478462.829321:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 321 00000100:00100000:1.0:1789478462.835373:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478462.836084:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945489920 00000100:00100000:2.0:1789478462.836094:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945489920 00000100:00100000:2.0:1789478462.836182:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 322 00000100:00100000:2.0:1789478462.836192:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:6164:x1876403945489920:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789478462.836331:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:6164:x1876403945489920:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 Request processed in 140us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478462.836339:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 322 00010000:00010000:1.0:1789478463.014663:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478464.037236:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478464.228842:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789478464.228864:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964440448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789478464.228931:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478464.229106:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964440448 00000100:00100000:2.0:1789478464.229114:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964440448 00000100:00100000:2.0:1789478464.229170:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789478464.229182:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964440448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789478464.229208:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789478464.229255:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964440448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478464.229269:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1789478464.229290:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789478464.230428:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb035e8700 x1876403964440448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478464.230450:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964440448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789478464.638493:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478464.638539:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478464.638573:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478464.638644:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478464.638690:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478464.638728:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945490304 00000100:00100000:0.0:1789478464.638740:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945490304 00000100:00100000:0.0:1789478464.638788:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945490560 00000100:00100000:0.0:1789478464.638791:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945490560 00000100:00100000:0.0:1789478464.638808:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945490176 00000100:00100000:0.0:1789478464.638811:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945490176 00000100:00100000:0.0:1789478464.638823:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945490432 00000100:00100000:0.0:1789478464.638825:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945490432 00000100:00100000:0.0:1789478464.638838:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 154 00000100:00100000:0.0:1789478464.638847:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945490304:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478464.638915:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945490304:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 69us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478464.638923:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 154 00000100:00100000:0.0:1789478464.638940:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 155 00000100:00100000:0.0:1789478464.638947:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2395:x1876403945490560:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478464.638976:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2395:x1876403945490560:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 29us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478464.638983:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 155 00000100:00100000:0.0:1789478464.638996:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 156 00000100:00100000:0.0:1789478464.639003:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2395:x1876403945490176:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478464.639024:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2395:x1876403945490176:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 22us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478464.639030:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 156 00000100:00100000:0.0:1789478464.639040:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 157 00000100:00100000:0.0:1789478464.639046:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2395:x1876403945490432:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478464.639065:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2395:x1876403945490432:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 20us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478464.639077:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 157 00000100:00080000:0.0:1789478464.639099:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789478464.639103:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789478464.639302:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945490048 00000100:00100000:2.0:1789478464.639307:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945490048 00000100:00100000:2.0:1789478464.639376:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 323 00000100:00100000:2.0:1789478464.639385:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2395:x1876403945490048:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1789478464.639424:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2395:x1876403945490048:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 41us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478464.639430:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 323 00000001:02000400:0.0:1789478464.689635:0:13378:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789478464.750459:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964440576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789478464.750532:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478464.750631:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964440576 00000100:00100000:0.0:1789478464.750640:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964440576 00000100:00100000:0.0:1789478464.750699:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789478464.750710:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964440576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789478464.750731:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478464.752028:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964440576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1316us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478464.752038:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1789478464.752068:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789478464.752362:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c1f100 x1876403964440576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478464.752396:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964440576:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789478465.061274:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478466.088822:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478466.277997:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964440704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789478466.278067:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478466.278146:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964440832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789478466.278152:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964440704 00000100:00100000:3.0:1789478466.278160:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964440704 00000100:00100000:0.0:1789478466.278185:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478466.278220:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964440832 00000100:00100000:3.0:1789478466.278225:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964440832 00000100:00100000:0.0:1789478466.278239:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789478466.278250:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc385ab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964440704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789478466.278282:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789478466.278334:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc385ab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964440704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478466.278417:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964441088:0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.278449:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478466.278470:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964441600:0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.278490:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478466.278505:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964442112:0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.278521:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478466.278538:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789478466.278542:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964441216:0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.278561:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478466.278590:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964441728:0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.278637:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478466.278655:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964442240:0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.278691:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478466.278716:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964441600 00000100:00100000:1.0:1789478466.278719:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964441600 00000100:00100000:1.0:1789478466.278744:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964442112 00000100:00100000:1.0:1789478466.278747:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964442112 00000100:00100000:1.0:1789478466.278757:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964441728 00000100:00100000:1.0:1789478466.278759:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964441728 00000100:00100000:1.0:1789478466.278770:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964442240 00000100:00100000:1.0:1789478466.278772:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964442240 00000100:00100000:1.0:1789478466.278785:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789478466.278790:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964441600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.278827:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964441600:12345-0@lo:400:kworker.0 Request processed in 36us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478466.278834:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789478466.278849:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789478466.278855:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964442112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.278881:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964442112:12345-0@lo:400:kworker.0 Request processed in 27us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478466.278887:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789478466.278897:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789478466.278903:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964441728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.278925:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964441728:12345-0@lo:400:kworker.0 Request processed in 23us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478466.278930:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789478466.278939:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789478466.278944:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964442240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.278964:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964442240:12345-0@lo:400:kworker.0 Request processed in 21us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478466.278975:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1789478466.279025:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40ffbb80 x1876403964441728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478466.279039:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964441728:0@lo:400:kworker.0 00010000:00080000:1.0:1789478466.279051:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb037aed80 x1876403964442240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478466.279059:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964442240:0@lo:400:kworker.0 00010000:00080000:1.0:1789478466.279066:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40ff9500 x1876403964441600/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478466.279073:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964441600:0@lo:400:kworker.0 00010000:00080000:1.0:1789478466.279081:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb037af800 x1876403964442112/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478466.279088:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964442112:0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.279129:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964441344:0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.279151:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478466.279169:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876403964441856:0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.279188:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478466.279204:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789478466.279210:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964440960:0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.279234:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478466.279257:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964441472:0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.279277:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478466.279295:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964441984:0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.279315:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478466.279340:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964441088 00000100:00100000:1.0:1789478466.279344:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964441088 00000100:00100000:1.0:1789478466.279363:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964441216 00000100:00100000:1.0:1789478466.279366:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964441216 00000100:00100000:1.0:1789478466.279375:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964441344 00000100:00100000:1.0:1789478466.279377:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964441344 00000100:00100000:1.0:1789478466.279388:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964441856 00000100:00100000:1.0:1789478466.279390:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964441856 00000100:00100000:1.0:1789478466.279400:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964441472 00000100:00100000:1.0:1789478466.279402:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964441472 00000100:00100000:1.0:1789478466.279412:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964441984 00000100:00100000:1.0:1789478466.279414:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964441984 00000100:00100000:1.0:1789478466.279426:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789478466.279432:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964441088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.279466:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964441088:12345-0@lo:400:kworker.0 Request processed in 34us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478466.279472:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789478466.279484:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789478466.279489:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964441216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.279516:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964441216:12345-0@lo:400:kworker.0 Request processed in 28us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478466.279522:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789478466.279532:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789478466.279537:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964441344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.279565:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964441344:12345-0@lo:400:kworker.0 Request processed in 28us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478466.279612:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789478466.279626:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789478466.279632:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876403964441856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.279661:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876403964441856:12345-0@lo:400:kworker.0 Request processed in 30us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478466.279667:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789478466.279678:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789478466.279684:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964441472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.279711:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964441472:12345-0@lo:400:kworker.0 Request processed in 27us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478466.279717:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789478466.279728:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789478466.279734:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964441984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.279759:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964441984:12345-0@lo:400:kworker.0 Request processed in 26us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478466.279765:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789478466.279781:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964440960 00000100:00100000:1.0:1789478466.279785:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964440960 00000100:00100000:1.0:1789478466.279809:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789478466.279815:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964440960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.279843:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964440960:12345-0@lo:400:kworker.0 Request processed in 29us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478466.279849:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789478466.279888:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964440960:0@lo:400:kworker.0 00010000:00080000:1.0:1789478466.279912:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40ffb100 x1876403964441472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478466.279922:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964441472:0@lo:400:kworker.0 00010000:00080000:1.0:1789478466.279936:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3cbc7800 x1876403964441984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478466.287674:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964441984:0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.287705:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964441344:0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.287716:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876403964441856:0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.287784:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964441216:0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.287798:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964441088:0@lo:400:kworker.0 00000100:00100000:1.0:1789478466.287831:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964440704:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1789478466.288734:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789478466.288739:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789478466.288742:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789478466.288745:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789478466.289066:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789478466.289089:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789478466.289103:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964440832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789478466.289146:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789478466.293678:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964440832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4571us (15485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478466.293693:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789478466.293848:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964440832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789478466.788875:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964442368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789478466.788876:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964442496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789478466.789253:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478466.789255:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478466.789448:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964442496 00000100:00100000:1.0:1789478466.789456:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964442496 00000100:00100000:1.0:1789478466.789498:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964442368 00000100:00100000:1.0:1789478466.789502:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964442368 00000100:00100000:1.0:1789478466.789522:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789478466.789532:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35dd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964442496:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789478466.789536:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789478466.789548:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964442368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789478466.789564:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1789478466.789580:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789478466.789688:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35dd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964442496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 157us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478466.789702:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:2.0:1789478466.789809:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb037aea00 x1876403964442496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478466.789830:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964442496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789478466.789881:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964442368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 334us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478466.789889:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1789478466.789945:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb037e7100 x1876403964442368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478466.789961:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964442368:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789478467.108740:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478468.133380:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789478468.802896:0:13527:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 09:21:07 (1789478467) === 00000100:00100000:0.0:1789478469.042353:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478469.042803:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945490688 00000100:00100000:1.0:1789478469.042972:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945490688 00000100:00080000:2.0:1789478469.043385:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789478469.043485:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478469.043546:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 22 00000100:00100000:1.0:1789478469.043570:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2396:x1876403945490688:12345-192.168.206.11@tcp:41:mkdir.0 00000004:00000024:1.0:1789478469.043637:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789478469.043716:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2396:x1876403945490688:12345-192.168.206.11@tcp:41:mkdir.0 Request processed in 161us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478469.043724:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 22 00000100:00100000:2.0:1789478469.044049:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945490816 00000100:00100000:2.0:1789478469.044055:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945490816 00000100:00100000:2.0:1789478469.044099:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 2 00000100:00100000:2.0:1789478469.044107:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:10475:x1876403945490816:12345-192.168.206.11@tcp:700:mkdir.0 00000100:00100000:2.0:1789478469.044142:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:10475:x1876403945490816:12345-192.168.206.11@tcp:700:mkdir.0 Request processed in 36us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478469.044149:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 2 00000100:00100000:0.0:1789478469.049020:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478469.049060:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945491072 00000100:00100000:1.0:1789478469.049070:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945491072 00000100:00100000:1.0:1789478469.049132:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 23 00000100:00100000:1.0:1789478469.049142:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:10475:x1876403945491072:12345-192.168.206.11@tcp:36:mkdir.0 00010000:00010000:1.0:1789478469.049188:0:10096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478469.049706:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e8215dbf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b71b9 expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.049725:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc40e36400) 00010000:00010000:1.0:1789478469.049753:0:10096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789478469.049837:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e8215f1d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.049909:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e8215f1d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.049920:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e8215f1d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.049965:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e8215f24 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.049971:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e8215f24 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.049976:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e8215f24 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.050585:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8215f2b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.050640:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8215f2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.050657:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8215f2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789478469.050673:0:10096:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd84f1b4 reply state 00000000e8a41c95 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8215f2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.050683:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8215f2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.050690:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ebc185a7400) 00010000:00010000:1.0:1789478469.050693:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789478469.050696:0:10096:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789478469.050701:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789478469.050707:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e8215f1d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.050713:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e8215f1d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.050736:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e8215f1d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.050743:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfc00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478469.050747:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e8215f1d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.050755:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e8215f1d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.050764:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc185a7e00) 00010000:00010000:1.0:1789478469.050767:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478469.050770:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e8215f1d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.050776:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e8215f1d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789478469.050789:0:10096:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd84f1b4 reply state 00000000e8a41c95 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e8215f24 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.050817:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e8215f24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.050823:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ebc185a7000) 00010000:00010000:1.0:1789478469.050825:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789478469.050827:0:10096:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789478469.050960:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:10475:x1876403945491072:12345-192.168.206.11@tcp:36:mkdir.0 Request processed in 1816us (1945us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789478469.050968:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 23 00000100:00100000:0.0:1789478469.060031:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478469.060133:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945491200 00000100:00100000:1.0:1789478469.060143:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945491200 00000100:00100000:1.0:1789478469.060198:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:1.0:1789478469.060208:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:10476:x1876403945491200:12345-192.168.206.11@tcp:101:chmod.0 00010000:00010000:1.0:1789478469.060227:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478469.060247:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e8215f32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b724c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.060304:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8215f39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.060316:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8215f39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.060327:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8215f39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478469.060375:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789478469.060380:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789478469.060866:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8215f39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.060896:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e8215f32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b724c expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.060914:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8215f39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b724c expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.060922:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc185a7e00) 00010000:00010000:1.0:1789478469.060925:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789478469.060941:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcf000, rc 0) 00000100:00100000:1.0:1789478469.061036:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:10476:x1876403945491200:12345-192.168.206.11@tcp:101:chmod.0 Request processed in 829us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478469.061044:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:0.0:1789478469.063549:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478469.063959:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945491456 00000100:00100000:1.0:1789478469.063968:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945491456 00000100:00100000:1.0:1789478469.064062:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:1.0:1789478469.064074:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:10476:x1876403945491456:12345-192.168.206.11@tcp:36:chmod.0 00010000:00010000:1.0:1789478469.064117:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478469.064139:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8215f39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b724c expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.064157:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc185a7e00) 00010000:00010000:1.0:1789478469.064165:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789478469.064187:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8215f40 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.064199:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8215f40 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.064208:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8215f40 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789478469.064379:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8b09fc8 reply state 00000000404aa63c transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8215f40 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.064403:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8215f40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.064417:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc185a7700) 00010000:00010000:1.0:1789478469.064425:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789478469.064429:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789478469.064436:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789478469.064506:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:10476:x1876403945491456:12345-192.168.206.11@tcp:36:chmod.0 Request processed in 433us (963us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789478469.064513:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:0.0:1789478469.081795:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478469.082026:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945491584 00000100:00100000:3.0:1789478469.082046:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945491584 00000100:00100000:3.0:1789478469.082215:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 26 00000100:00100000:3.0:1789478469.082226:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:10477:x1876403945491584:12345-192.168.206.11@tcp:101:chown.0 00010000:00010000:3.0:1789478469.082253:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478469.082276:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8215f47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7253 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.082350:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8215f4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.082364:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8215f4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.082377:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8215f4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478469.082815:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789478469.082820:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789478469.082929:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8215f4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.082957:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8215f47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7253 expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.082976:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8215f4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7253 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.082985:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc185a7700) 00010000:00010000:3.0:1789478469.082988:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789478469.082991:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fd000, rc 0) 00000100:00100000:3.0:1789478469.084730:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+10:10477:x1876403945491584:12345-192.168.206.11@tcp:101:chown.0 Request processed in 2497us (2934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478469.084741:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 26 00000100:00100000:2.0:1789478469.087231:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478469.087429:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945491712 00000100:00100000:0.0:1789478469.087438:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945491712 00000100:00100000:0.0:1789478469.087551:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 27 00000100:00100000:0.0:1789478469.087572:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+10:10477:x1876403945491712:12345-192.168.206.11@tcp:101:chown.0 00010000:00010000:0.0:1789478469.087622:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478469.087642:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8215f55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b725a expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.087702:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67200/0x8ebaae74e8215f5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.087721:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67200/0x8ebaae74e8215f5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.087732:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67200/0x8ebaae74e8215f5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.087771:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8215f63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.087780:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8215f63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.087787:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8215f63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.087867:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e8215f6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.087876:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e8215f6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.087882:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e8215f6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789478469.087921:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789478469.087925:0:10096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789478469.087946:0:10096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e8215f6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.087957:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67200/0x8ebaae74e8215f5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.087963:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67200/0x8ebaae74e8215f5c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.087970:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67200/0x8ebaae74e8215f5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.087985:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67200 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478469.087990:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67200/0x8ebaae74e8215f5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.087997:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67200/0x8ebaae74e8215f5c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.088009:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc185a7700) 00010000:00010000:0.0:1789478469.088012:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478469.088017:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67200/0x8ebaae74e8215f5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.088022:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67200/0x8ebaae74e8215f5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.088035:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8215f63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.088041:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8215f63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.088047:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8215f63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.088052:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b66e00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478469.088056:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8215f63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.088062:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8215f63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.088093:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ebc185a7000) 00010000:00010000:0.0:1789478469.088096:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478469.088099:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8215f63 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.088106:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8215f63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.088138:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8215f55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b725a expref: 12 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.088151:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e8215f6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b725a expref: 11 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.088158:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ebc185a7400) 00010000:00010000:0.0:1789478469.088160:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789478469.088163:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b67e00, rc 0) 00000100:00100000:0.0:1789478469.088234:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+11:10477:x1876403945491712:12345-192.168.206.11@tcp:101:chown.0 Request processed in 664us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478469.088241:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 27 00000100:00100000:0.0:1789478469.090410:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478469.090466:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945491840 00000100:00100000:3.0:1789478469.090474:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945491840 00000100:00100000:3.0:1789478469.090533:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00100000:3.0:1789478469.090543:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+11:10477:x1876403945491840:12345-192.168.206.11@tcp:900:chown.0 00000100:00100000:3.0:1789478469.090745:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+11:10477:x1876403945491840:12345-192.168.206.11@tcp:900:chown.0 Request processed in 202us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478469.090754:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00100000:3.0:1789478469.092814:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478469.092979:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945492096 00000100:00100000:1.0:1789478469.092987:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945492096 00000100:00100000:1.0:1789478469.093035:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 28 00000100:00100000:1.0:1789478469.093046:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+11:10477:x1876403945492096:12345-192.168.206.11@tcp:36:chown.0 00010000:00010000:1.0:1789478469.093104:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478469.093130:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e8215f6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b725a expref: 11 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.093148:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ebc185a7400) 00010000:00010000:1.0:1789478469.093153:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789478469.093174:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8215f71 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.093187:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8215f71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.093196:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8215f71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789478469.096921:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:2.0:1789478469.097081:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa7e5b67 reply state 00000000c042d5f5 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8215f71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478469.097102:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8215f71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478469.097110:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ebc185a7400) 00010000:00010000:2.0:1789478469.097113:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789478469.097118:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789478469.097129:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1789478469.097228:0:6519:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789478469.097248:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:10477:x1876403945492096:12345-192.168.206.11@tcp:36:chown.0 Request processed in 4201us (4448us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789478469.097257:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 28 00010000:00010000:0.0:1789478469.097358:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e8215f24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.097367:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e8215f24 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.097374:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e8215f24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.097389:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fce800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478469.097404:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e8215f24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.097412:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e8215f24 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.097423:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ebc185a7000) 00010000:00010000:0.0:1789478469.097425:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478469.097429:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e8215f24 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.097435:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e8215f24 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.097451:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8215f2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.097458:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8215f2b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.097463:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8215f2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.097467:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfe00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478469.097469:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8215f2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.097474:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8215f2b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.097492:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ebc185a7400) 00010000:00010000:0.0:1789478469.097494:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478469.097497:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8215f2b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.097504:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8215f2b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.097515:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8215f40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.097521:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8215f40 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.097527:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8215f40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.097532:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcea00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478469.097534:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8215f40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.097540:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8215f40 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.097548:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc185a7700) 00010000:00010000:0.0:1789478469.097550:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789478469.097553:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8215f40 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.097568:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8215f40 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.097668:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8215f71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.097676:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8215f71 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.097687:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8215f71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.098007:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcf000 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478469.098011:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8215f71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.098017:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8215f71 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.098025:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ebc185a7400) 00010000:00010000:1.0:1789478469.098027:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789478469.098030:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8215f71 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.098036:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8215f71 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478469.115400:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478469.115488:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945492224 00000100:00100000:1.0:1789478469.115497:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945492224 00000100:00100000:1.0:1789478469.115642:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 29 00000100:00100000:1.0:1789478469.115653:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:10478:x1876403945492224:12345-192.168.206.11@tcp:101:touch.500 00010000:00010000:1.0:1789478469.115674:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478469.115692:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8215f78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7261 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789478469.122630:0:6518:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 6887us 00010000:00010000:3.0:1789478469.133391:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fde00/0x8ebaae74e8215f7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.133476:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fde00/0x8ebaae74e8215f7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.133488:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fde00/0x8ebaae74e8215f7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.133503:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8215f86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.133510:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8215f86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.133589:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8215f86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.133692:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc200/0x8ebaae74e8215f8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.133811:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc200/0x8ebaae74e8215f8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.133818:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc200/0x8ebaae74e8215f8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478469.133854:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789478469.133857:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789478469.133888:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc200/0x8ebaae74e8215f8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.133899:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fde00/0x8ebaae74e8215f7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.133906:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fde00/0x8ebaae74e8215f7f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.133913:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fde00/0x8ebaae74e8215f7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.133918:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fde00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478469.133922:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fde00/0x8ebaae74e8215f7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.133928:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fde00/0x8ebaae74e8215f7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.133940:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc185a7700) 00010000:00010000:3.0:1789478469.133942:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478469.133947:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fde00/0x8ebaae74e8215f7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.133952:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fde00/0x8ebaae74e8215f7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.134124:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8215f86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.134141:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8215f86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.134146:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8215f86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.134152:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478469.134155:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8215f86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.134160:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8215f86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.134169:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ebb02275a00) 00010000:00010000:3.0:1789478469.134172:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478469.134175:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8215f86 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.134181:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8215f86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.134281:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8215f78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7261 expref: 8 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.134297:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc200/0x8ebaae74e8215f8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7261 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.134304:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ebb02275800) 00010000:00010000:3.0:1789478469.134306:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789478469.134314:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fc200, rc 0) 00000100:00100000:3.0:1789478469.134382:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:10478:x1876403945492224:12345-192.168.206.11@tcp:101:touch.500 Request processed in 18731us (18990us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478469.134390:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 29 00000100:00100000:3.0:1789478469.141829:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478469.141908:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945492480 00000100:00100000:1.0:1789478469.141928:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945492480 00000100:00100000:1.0:1789478469.142116:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 30 00000100:00100000:1.0:1789478469.142127:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:10478:x1876403945492480:12345-192.168.206.11@tcp:101:touch.500 00010000:00010000:1.0:1789478469.142147:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478469.142167:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e8215f94 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7268 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.142266:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e8215f9b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.142281:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e8215f9b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.142291:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e8215f9b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.142360:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfa00/0x8ebaae74e8215fa2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.142369:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfa00/0x8ebaae74e8215fa2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.142376:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfa00/0x8ebaae74e8215fa2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789478469.142795:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789478469.142927:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8215fa9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.142937:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8215fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.142969:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8215fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.143002:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e8215f9b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.143010:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e8215f9b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.143017:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e8215f9b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.143023:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fce400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478469.143027:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e8215f9b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.143035:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e8215f9b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.143046:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ebb02275800) 00010000:00010000:1.0:1789478469.143049:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478469.143053:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e8215f9b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.143059:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e8215f9b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789478469.143070:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000777496ba reply state 000000006ca7cefc transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfa00/0x8ebaae74e8215fa2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.143080:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfa00/0x8ebaae74e8215fa2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.143092:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xeb7e073f (ffff8ebc185a7400) 00010000:00010000:1.0:1789478469.143095:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789478469.143097:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789478469.143124:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e8215f94 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7268 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.143139:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8215fa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7268 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.143145:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ebc185a7e00) 00010000:00010000:1.0:1789478469.143147:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789478469.143150:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcf200, rc 0) 00000100:00100000:1.0:1789478469.143213:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+10:10478:x1876403945492480:12345-192.168.206.11@tcp:101:touch.500 Request processed in 1088us (1390us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789478469.143221:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 30 00000100:00100000:0.0:1789478469.149829:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478469.150006:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945492736 00000100:00100000:1.0:1789478469.150015:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945492736 00000100:00100000:3.0:1789478469.150139:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 31 00000100:00100000:3.0:1789478469.150153:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+10:10478:x1876403945492736:12345-192.168.206.11@tcp:36:touch.500 00010000:00010000:3.0:1789478469.150318:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478469.150342:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8215fa9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7268 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.150361:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ebc185a7e00) 00010000:00010000:3.0:1789478469.150370:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789478469.150421:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8215fb7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.150433:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8215fb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.150442:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8215fb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789478469.150532:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eac600c4 reply state 000000005abc53b8 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8215fb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.150544:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8215fb7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.150551:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ebb02275a00) 00010000:00010000:3.0:1789478469.151159:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789478469.151192:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789478469.151303:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+11:10478:x1876403945492736:12345-192.168.206.11@tcp:36:touch.500 Request processed in 1152us (1479us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789478469.151312:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 31 00000100:00100000:0.0:1789478469.153241:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478469.153381:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945492864 00000100:00100000:2.0:1789478469.153389:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945492864 00000100:00100000:2.0:1789478469.153483:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 32 00000100:00100000:2.0:1789478469.153491:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+11:10478:x1876403945492864:12345-192.168.206.11@tcp:101:touch.500 00010000:00010000:2.0:1789478469.153509:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478469.153527:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8215fbe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b726f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478469.153621:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8215fbe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b726f expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478469.153637:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8215fbe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b726f expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478469.153679:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ebb02275a00) 00010000:00010000:2.0:1789478469.153683:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789478469.153686:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76400, rc 0) 00000100:00100000:2.0:1789478469.153734:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+12:10478:x1876403945492864:12345-192.168.206.11@tcp:101:touch.500 Request processed in 242us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478469.153741:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 32 00010000:00010000:3.0:1789478469.157801:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478469.158861:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478469.158940:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945492992 00000100:00100000:1.0:1789478469.158950:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945492992 00000100:00100000:1.0:1789478469.159094:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:1.0:1789478469.159102:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1876403945492992:12345-192.168.206.11@tcp:8:touch.500 00010000:00080000:1.0:1789478469.159135:0:8829:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp t0 exp 0000000000000000 cur 298 last 0 00000020:00000080:1.0:1789478469.159175:0:8829:0:(genops.c:1385:class_connect()) connect: client 327dd6d5-45fd-4b52-99bf-74d27d1ede6e, cookie 0x8ebaae74e8215fc5 00002000:00100000:1.0:1789478469.159186:0:8829:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 327dd6d5-45fd-4b52-99bf-74d27d1ede6e/ffff8ebb03685800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789478469.159201:0:8829:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789478469.159267:0:8829:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789478469.159305:0:8829:0:(import.c:65:import_set_state_nolock()) ffff8ebb03681800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789478469.159379:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2394:x1876403945492992:12345-192.168.206.11@tcp:8:touch.500 Request processed in 275us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478469.159387:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:0.0:1789478469.162269:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478469.162349:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945493120 00000100:00100000:1.0:1789478469.162358:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945493120 00000100:00100000:1.0:1789478469.162421:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:1.0:1789478469.162430:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:0:x1876403945493120:12345-192.168.206.11@tcp:2:touch.500 00000100:00080000:2.0:1789478469.162716:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789478469.173631:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:0.0:1789478469.173644:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 327dd6d5-45fd-4b52-99bf-74d27d1ede6e 00000100:00100000:1.0:1789478469.173804:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:0:x1876403945493120:12345-192.168.206.11@tcp:2:touch.500 Request processed in 11369us (11536us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789478469.173815:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:0.0:1789478469.176646:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478469.176808:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945493376 00000100:00100000:3.0:1789478469.176978:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945493376 00000100:00100000:2.0:1789478469.177102:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 2 00000100:00100000:2.0:1789478469.177113:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+12:10478:x1876403945493376:12345-192.168.206.11@tcp:35:touch.500 00000100:00100000:2.0:1789478469.177403:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+13:10478:x1876403945493376:12345-192.168.206.11@tcp:35:touch.500 Request processed in 291us (762us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789478469.177411:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 2 00000100:00100000:0.0:1789478469.189092:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478469.189697:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945493504 00000100:00100000:1.0:1789478469.189707:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945493504 00000100:00100000:1.0:1789478469.189778:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 33 00000100:00100000:1.0:1789478469.189788:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+13:10479:x1876403945493504:12345-192.168.206.11@tcp:101:rm.0 00010000:00010000:1.0:1789478469.189812:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478469.189985:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e8215fcc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7276 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.190072:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e8215fd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.190084:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e8215fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.190094:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e8215fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478469.190397:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789478469.190412:0:10096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789478469.190449:0:10096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e8215fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.190476:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e8215fcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7276 expref: 15 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.190491:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e8215fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7276 expref: 14 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.190499:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ebb02275800) 00010000:00010000:1.0:1789478469.190502:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789478469.190505:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fce400, rc 0) 00000100:00100000:1.0:1789478469.190571:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+14:10479:x1876403945493504:12345-192.168.206.11@tcp:101:rm.0 Request processed in 784us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478469.190578:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 33 00000100:00100000:0.0:1789478469.194127:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478469.194329:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945493760 00000100:00100000:1.0:1789478469.194339:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945493760 00000100:00100000:1.0:1789478469.194434:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 34 00000100:00100000:1.0:1789478469.194444:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+14:10479:x1876403945493760:12345-192.168.206.11@tcp:101:rm.0 00010000:00010000:1.0:1789478469.194463:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478469.194484:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8215fda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b727d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478469.194621:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789478469.194770:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8215fda lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b727d expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.194785:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc185a7700) 00010000:00010000:1.0:1789478469.194795:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789478469.194800:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8215fda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b727d expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.194813:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcf200, rc 0) 00000100:00100000:1.0:1789478469.194873:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+15:10479:x1876403945493760:12345-192.168.206.11@tcp:101:rm.0 Request processed in 430us (755us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1789478469.194881:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 34 00000100:00100000:0.0:1789478469.199122:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478469.199289:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945493888 00000100:00100000:3.0:1789478469.199299:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945493888 00000100:00100000:3.0:1789478469.199345:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:3.0:1789478469.199355:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+15:10479:x1876403945493888:12345-192.168.206.11@tcp:37:rm.0 00000100:00100000:3.0:1789478469.205385:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+15:10479:x1876403945493888:12345-192.168.206.11@tcp:37:rm.0 Request processed in 6023us (6262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478469.205397:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:0.0:1789478469.209441:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478469.209985:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945494144 00000100:00100000:2.0:1789478469.209995:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945494144 00000100:00100000:2.0:1789478469.210351:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:2.0:1789478469.210361:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc0838d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+15:10479:x1876403945494144:12345-192.168.206.11@tcp:35:rm.0 00000100:00100000:2.0:1789478469.210620:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc0838d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+16:10479:x1876403945494144:12345-192.168.206.11@tcp:35:rm.0 Request processed in 260us (1186us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789478469.210628:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:0.0:1789478469.213977:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478469.216276:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945494400 00000100:00100000:1.0:1789478469.216289:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945494400 00000100:00100000:1.0:1789478469.216412:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 35 00000100:00100000:1.0:1789478469.216423:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+16:10479:x1876403945494400:12345-192.168.206.11@tcp:101:rm.0 00010000:00010000:1.0:1789478469.216445:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478469.216462:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8215fe8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7284 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.216570:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e8215fef lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.216584:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e8215fef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.216611:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e8215fef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478469.216622:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789478469.216917:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8215fe8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7284 expref: 19 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.216946:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e8215fef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7284 expref: 18 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.216956:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ebb02275800) 00010000:00010000:1.0:1789478469.216959:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789478469.216962:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcfc00, rc 0) 00000100:00100000:1.0:1789478469.217193:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:10479:x1876403945494400:12345-192.168.206.11@tcp:101:rm.0 Request processed in 763us (3214us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789478469.217201:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 35 00000100:00100000:0.0:1789478469.220366:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478469.220442:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945494528 00000100:00100000:2.0:1789478469.220451:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945494528 00000100:00100000:2.0:1789478469.220508:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 36 00000100:00100000:2.0:1789478469.220519:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:10479:x1876403945494528:12345-192.168.206.11@tcp:41:rm.0 00000004:00000024:2.0:1789478469.220581:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1789478469.221079:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:10479:x1876403945494528:12345-192.168.206.11@tcp:41:rm.0 Request processed in 560us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478469.221094:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 36 00000100:00100000:0.0:1789478469.223232:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478469.223405:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945494656 00000100:00100000:3.0:1789478469.223414:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945494656 00000100:00100000:3.0:1789478469.223467:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 37 00000100:00100000:3.0:1789478469.223479:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:10479:x1876403945494656:12345-192.168.206.11@tcp:101:rm.0 00010000:00010000:3.0:1789478469.223497:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478469.223516:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fde00/0x8ebaae74e8215ffd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b728b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.223587:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc800/0x8ebaae74e8216004 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.223712:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc800/0x8ebaae74e8216004 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.223722:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc800/0x8ebaae74e8216004 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.223741:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc600/0x8ebaae74e821600b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.223746:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc600/0x8ebaae74e821600b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.223750:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc600/0x8ebaae74e821600b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.224023:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216012 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.224030:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.224034:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478469.224059:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789478469.224062:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789478469.224074:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.224081:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.224086:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc800/0x8ebaae74e8216004 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.224090:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc800/0x8ebaae74e8216004 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.224101:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc800/0x8ebaae74e8216004 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.224105:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fc800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478469.224109:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc800/0x8ebaae74e8216004 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.224113:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc800/0x8ebaae74e8216004 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.224121:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ebb02275800) 00010000:00010000:3.0:1789478469.224124:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478469.224126:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc800/0x8ebaae74e8216004 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.224130:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc800/0x8ebaae74e8216004 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.224137:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc600/0x8ebaae74e821600b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.224141:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc600/0x8ebaae74e821600b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.224156:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc600/0x8ebaae74e821600b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.224159:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fc600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478469.224161:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc600/0x8ebaae74e821600b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.224171:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc600/0x8ebaae74e821600b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.224176:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xeb7e073f (ffff8ebc185a7400) 00010000:00010000:3.0:1789478469.224178:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478469.224179:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc600/0x8ebaae74e821600b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.224183:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc600/0x8ebaae74e821600b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.224200:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fde00/0x8ebaae74e8215ffd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b728b expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.224224:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216012 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b728b expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.224228:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ebb02275a00) 00010000:00010000:3.0:1789478469.224229:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789478469.224231:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fd600, rc 0) 00000100:00100000:3.0:1789478469.224278:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+19:10479:x1876403945494656:12345-192.168.206.11@tcp:101:rm.0 Request processed in 802us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478469.224285:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 37 00000100:00100000:0.0:1789478469.226484:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478469.226713:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945494912 00000100:00100000:1.0:1789478469.226722:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945494912 00000100:00100000:1.0:1789478469.226778:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 38 00000100:00100000:1.0:1789478469.226789:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+19:10479:x1876403945494912:12345-192.168.206.11@tcp:36:rm.0 00010000:00010000:1.0:1789478469.226832:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789478469.226854:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216012 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b728b expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.226874:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8215fbe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b726f expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.226887:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ebb02275a00) 00010000:00010000:1.0:1789478469.226896:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e8215fd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7276 expref: 17 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.226905:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ebb02275800) 00010000:00010000:1.0:1789478469.226919:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789478469.226937:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8216019 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.226948:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8216019 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.226958:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8216019 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.226969:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8216020 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.226977:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8216020 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.226984:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8216020 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.227071:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8216027 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.227080:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8216027 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.227086:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8216027 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789478469.227287:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789478469.227296:0:6517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 298342701996ns, next at 299342699939ns, rc = 0 00010000:00010000:1.0:1789478469.227333:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e821602e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.227350:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e821602e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.227357:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e821602e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.227364:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e821602e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.227370:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e821602e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.227375:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e821602e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.227401:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789478469.227423:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8216027 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.227428:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8216027 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.227434:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8216027 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.227439:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcea00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478469.227443:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8216027 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.227450:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8216027 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.227468:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ebb02275a00) 00010000:00010000:1.0:1789478469.227470:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789478469.227474:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8216027 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.227479:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8216027 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.227491:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8216019 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.227497:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8216019 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.227503:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8216019 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.227508:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcf200 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478469.227511:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8216019 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.227517:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8216019 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.227523:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ebb02275800) 00010000:00010000:1.0:1789478469.227526:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478469.227528:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8216019 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.227533:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8216019 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789478469.227550:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b1ca62a0 reply state 000000008ee34012 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8216020 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.227711:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789478469.227718:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e821602e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.227725:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfe00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478469.227734:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e821602e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.227741:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e821602e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.227749:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ebb02275a00) 00010000:00010000:3.0:1789478469.227751:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789478469.227754:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e821602e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.227760:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e821602e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478469.227770:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478469.227771:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478469.227773:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478469.228141:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8216020 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.228149:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xeb7e073f (ffff8ebc185a7400) 00010000:00010000:1.0:1789478469.228151:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789478469.228154:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789478469.228919:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:10479:x1876403945494912:12345-192.168.206.11@tcp:36:rm.0 Request processed in 2127us (2450us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789478469.228929:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 38 00000100:00100000:0.0:1789478469.233036:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478469.233111:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945495168 00000100:00100000:3.0:1789478469.233120:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945495168 00000100:00100000:3.0:1789478469.233175:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:3.0:1789478469.233185:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:10479:x1876403945495168:12345-192.168.206.11@tcp:35:rm.0 00000100:00100000:3.0:1789478469.233384:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+19:10479:x1876403945495168:12345-192.168.206.11@tcp:35:rm.0 Request processed in 200us (355us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789478469.233391:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:3.0:1789478469.235807:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478469.235921:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945495424 00000100:00100000:1.0:1789478469.235929:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945495424 00000100:00100000:1.0:1789478469.236053:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 39 00000100:00100000:1.0:1789478469.236063:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+19:10479:x1876403945495424:12345-192.168.206.11@tcp:36:rm.0 00010000:00010000:1.0:1789478469.236109:0:10096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789478469.236134:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e8215fef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7284 expref: 19 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.236155:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc200/0x8ebaae74e8215f8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7261 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.236167:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ebb02275800) 00010000:00010000:1.0:1789478469.236180:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8215f4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7253 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.236189:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc185a7700) 00010000:00010000:1.0:1789478469.236195:0:10096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789478469.236932:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e8216035 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.236957:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e8216035 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.237071:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e8216035 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.237087:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc00030a00/0x8ebaae74e821603c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.237095:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc00030a00/0x8ebaae74e821603c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.237102:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc00030a00/0x8ebaae74e821603c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.237177:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc00031200/0x8ebaae74e8216043 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.237184:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc00031200/0x8ebaae74e8216043 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478469.237191:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc00031200/0x8ebaae74e8216043 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789478469.237926:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789478469.237943:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc00031200/0x8ebaae74e8216043 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.237951:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc00031200/0x8ebaae74e8216043 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.238020:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc00031200/0x8ebaae74e8216043 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.238035:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc00031200 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478469.238040:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc00031200/0x8ebaae74e8216043 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.238048:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc00031200/0x8ebaae74e8216043 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.238058:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ebc185a7200) 00010000:00010000:0.0:1789478469.238061:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789478469.238065:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc00031200/0x8ebaae74e8216043 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.238071:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc00031200/0x8ebaae74e8216043 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.238092:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e8216035 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.238099:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e8216035 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.238104:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e8216035 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.238109:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fce800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478469.238112:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e8216035 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.238118:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e8216035 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.238135:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc185a7500) 00010000:00010000:0.0:1789478469.238137:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478469.238140:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e8216035 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.238145:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e8216035 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789478469.238156:0:10096:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024fb2b54 reply state 00000000af75bf3b transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc00030a00/0x8ebaae74e821603c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.238166:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc00030a00/0x8ebaae74e821603c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478469.238173:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ebc185a7c00) 00010000:00010000:0.0:1789478469.238175:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789478469.238178:0:10096:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789478469.238250:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:10479:x1876403945495424:12345-192.168.206.11@tcp:36:rm.0 Request processed in 2186us (2447us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789478469.238258:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 39 00000100:00100000:1.0:1789478469.348991:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964442624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789478469.349069:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478469.349195:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964442624 00000100:00100000:2.0:1789478469.349203:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964442624 00000100:00100000:2.0:1789478469.349260:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789478469.349271:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964442624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789478469.349297:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789478469.349340:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964442624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478469.349346:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1789478469.349408:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789478469.349435:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc08885500 x1876403964442624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478469.349453:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964442624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789478469.757484:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478469.757527:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478469.757572:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478469.757628:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478469.757657:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945495552 00000100:00100000:0.0:1789478469.757666:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945495552 00000100:00100000:0.0:1789478469.757712:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 325 00000100:00100000:0.0:1789478469.757722:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2398:x1876403945495552:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478469.757795:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2398:x1876403945495552:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 74us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478469.757803:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 325 00000100:00100000:0.0:1789478469.757834:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945495680 00000100:00100000:0.0:1789478469.757838:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945495680 00000100:00100000:3.0:1789478469.757947:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945495936 00000100:00100000:3.0:1789478469.757952:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945495936 00000100:00100000:3.0:1789478469.757974:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945495808 00000100:00100000:3.0:1789478469.757977:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945495808 00000100:00100000:3.0:1789478469.757992:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 164 00000100:00100000:3.0:1789478469.757999:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2398:x1876403945495680:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478469.758037:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2398:x1876403945495680:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 39us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478469.758045:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 164 00000100:00100000:3.0:1789478469.758069:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 165 00000100:00100000:3.0:1789478469.758075:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2398:x1876403945495936:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478469.758101:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2398:x1876403945495936:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 26us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478469.758106:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 165 00000100:00100000:3.0:1789478469.758118:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 166 00000100:00100000:3.0:1789478469.758125:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2398:x1876403945495808:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478469.758150:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2398:x1876403945495808:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 25us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478469.758167:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 166 00000100:00080000:1.0:1789478469.758646:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789478469.758651:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789478469.861143:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964442752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789478469.861210:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478469.861375:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964442752 00000100:00100000:0.0:1789478469.861383:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964442752 00000100:00100000:0.0:1789478469.861443:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789478469.861453:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03784a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964442752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789478469.861485:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478469.861538:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03784a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964442752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478469.861545:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1789478469.861695:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c1c380 x1876403964442752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478469.861715:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964442752:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789478469.861789:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789478470.182921:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478471.209782:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478471.396959:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964442880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789478471.397028:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478471.397134:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964442880 00000100:00100000:0.0:1789478471.397142:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964442880 00000100:00100000:0.0:1789478471.397196:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789478471.397208:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964442880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789478471.397242:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789478471.397309:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964442880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478471.397318:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789478471.397390:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964442880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789478471.398033:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964443136:0@lo:400:kworker.0 00000100:00100000:1.0:1789478471.398066:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478471.398087:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964443648:0@lo:400:kworker.0 00000100:00100000:1.0:1789478471.398107:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478471.398121:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876403964444160:0@lo:400:kworker.0 00000100:00100000:1.0:1789478471.398140:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478471.398156:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789478471.398161:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964443264:0@lo:400:kworker.0 00000100:00100000:1.0:1789478471.398184:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478471.398204:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964443392:0@lo:400:kworker.0 00000100:00100000:0.0:1789478471.398245:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478471.398266:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964443904:0@lo:400:kworker.0 00000100:00100000:0.0:1789478471.398294:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478471.398307:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964443008:0@lo:400:kworker.0 00000100:00100000:0.0:1789478471.398314:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964444416:0@lo:400:kworker.0 00000100:00100000:2.0:1789478471.398351:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478471.398355:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478471.398526:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876403964443520:0@lo:400:kworker.0 00000100:00100000:2.0:1789478471.398560:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478471.398572:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876403964444032:0@lo:400:kworker.0 00000100:00100000:2.0:1789478471.398590:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478471.398615:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789478471.398625:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964444544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789478471.398654:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478471.398694:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964443776:0@lo:400:kworker.0 00000100:00100000:1.0:1789478471.398717:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478471.398760:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964443136 00000100:00100000:0.0:1789478471.398766:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964443136 00000100:00100000:2.0:1789478471.398918:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964443264 00000100:00100000:2.0:1789478471.398923:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964443264 00000100:00100000:2.0:1789478471.398954:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964444544 00000100:00100000:2.0:1789478471.398957:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964444544 00000100:00100000:2.0:1789478471.398972:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789478471.398979:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1876403964443264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478471.399018:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1876403964443264:12345-0@lo:400:kworker.0 Request processed in 39us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478471.399025:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789478471.399051:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789478471.399058:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964444544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789478471.399077:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789478471.399110:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964444544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478471.399116:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789478471.399134:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964443648 00000100:00100000:2.0:1789478471.399137:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964443648 00000100:00100000:2.0:1789478471.399159:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964444160 00000100:00100000:2.0:1789478471.399162:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964444160 00000100:00100000:2.0:1789478471.399179:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964443392 00000100:00100000:2.0:1789478471.399182:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964443392 00000100:00100000:0.0:1789478471.399186:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964443520 00000100:00100000:0.0:1789478471.399192:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964443520 00000100:00100000:2.0:1789478471.399210:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964444032 00000100:00100000:2.0:1789478471.399215:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964444032 00000100:00100000:0.0:1789478471.399219:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789478471.399230:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964443648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478471.399240:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789478471.399249:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964443136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478471.399270:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964443648:12345-0@lo:400:kworker.0 Request processed in 42us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478471.399279:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789478471.399290:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964443136:12345-0@lo:400:kworker.0 Request processed in 41us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478471.399297:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789478471.399305:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876403964444160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478471.399335:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876403964444160:12345-0@lo:400:kworker.0 Request processed in 31us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478471.400606:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964444288:0@lo:400:kworker.0 00000100:00100000:3.0:1789478471.400654:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964443904 00000100:00100000:3.0:1789478471.400662:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964443904 00000100:00100000:3.0:1789478471.400701:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964444416 00000100:00100000:3.0:1789478471.400705:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964444416 00000100:00100000:3.0:1789478471.400720:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964443776 00000100:00100000:3.0:1789478471.400732:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964443776 00000100:00100000:3.0:1789478471.400807:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789478471.400818:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964443904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478471.400868:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964443904:12345-0@lo:400:kworker.0 Request processed in 53us (2574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478471.400874:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789478471.400888:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789478471.400894:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964444416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478471.400920:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964444416:12345-0@lo:400:kworker.0 Request processed in 27us (2571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478471.400925:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789478471.400935:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789478471.400940:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964443776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478471.400965:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964443776:12345-0@lo:400:kworker.0 Request processed in 25us (2247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478471.400970:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789478471.401008:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789478471.401015:0:6517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1789478471.401028:0:6519:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789478471.402952:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789478471.402987:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789478471.403000:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964443392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478471.403063:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964443392:12345-0@lo:400:kworker.0 Request processed in 70us (4818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478471.403070:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789478471.403082:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789478471.403089:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876403964443520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478471.403120:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876403964443520:12345-0@lo:400:kworker.0 Request processed in 33us (4559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478471.403136:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789478471.403147:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789478471.403154:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876403964444032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478471.403201:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876403964444032:12345-0@lo:400:kworker.0 Request processed in 48us (4609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478471.403206:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789478471.403238:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964443008 00000100:00100000:2.0:1789478471.403244:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964443008 00000100:00100000:1.0:1789478471.403258:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478471.403283:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789478471.403290:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3648:x1876403964443008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478471.403307:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964443136:0@lo:400:kworker.0 00000100:00100000:2.0:1789478471.403327:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3648:x1876403964443008:12345-0@lo:400:kworker.0 Request processed in 36us (4978us total) trans 0 rc 0/0 00010000:00080000:1.0:1789478471.403331:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb037ad180 x1876403964443648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478471.403337:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1789478471.403348:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964443648:0@lo:400:kworker.0 00010000:00080000:1.0:1789478471.403366:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3cbc5f80 x1876403964444160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478471.403376:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876403964444160:0@lo:400:kworker.0 00000100:00100000:2.0:1789478471.403382:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964443008:0@lo:400:kworker.0 00000100:00100000:1.0:1789478471.403417:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964443264:0@lo:400:kworker.0 00010000:00080000:1.0:1789478471.403429:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb037aea00 x1876403964443776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478471.403438:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964443776:0@lo:400:kworker.0 00000100:00080000:1.0:1789478471.403456:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789478471.403461:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789478471.403463:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789478471.403466:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789478471.403476:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964444288 00000100:00100000:1.0:1789478471.403479:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964444288 00000100:00100000:1.0:1789478471.403511:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789478471.403518:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964444288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478471.403569:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964444288:12345-0@lo:400:kworker.0 Request processed in 51us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478471.403575:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1789478471.403607:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789478471.403626:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3cbc5180 x1876403964444288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478471.403636:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964444288:0@lo:400:kworker.0 00000100:00100000:1.0:1789478471.403680:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964444544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478471.403692:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964443392:0@lo:400:kworker.0 00010000:00080000:1.0:1789478471.403703:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3cbc5500 x1876403964443904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478471.403712:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964443904:0@lo:400:kworker.0 00010000:00080000:1.0:1789478471.403732:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3cbc5880 x1876403964444416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478471.403740:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964444416:0@lo:400:kworker.0 00000100:00100000:2.0:1789478471.404300:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876403964443520:0@lo:400:kworker.0 00000100:00100000:2.0:1789478471.404320:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876403964444032:0@lo:400:kworker.0 00000100:00100000:0.0:1789478471.404623:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000004:00080000:0.0:1789478471.908810:0:9999:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 301024213878ns, next at 302024211405ns, rc = 0 00000100:00100000:2.0:1789478471.908964:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789478471.908984:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964444672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789478471.909060:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478471.909339:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789478471.909349:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964444800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789478471.909377:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478471.909455:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964444672 00000100:00100000:3.0:1789478471.909462:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964444672 00000100:00100000:3.0:1789478471.909521:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964444800 00000100:00100000:3.0:1789478471.909524:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964444800 00000100:00100000:3.0:1789478471.909553:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789478471.909563:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964444672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789478471.909588:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478471.909653:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964444672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478471.909673:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789478471.909690:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789478471.909697:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964444800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789478471.909707:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478471.909750:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964444800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478471.909756:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1789478471.909789:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03784e00 x1876403964444800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478471.909807:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964444800:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1789478471.910034:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40ecc700 x1876403964444672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478471.910064:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964444672:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789478472.230393:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789478472.349307:0:13675:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000020:00000080:3.0:1789478473.180825:0:13723:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea7dc42b0 20000000:00000080:3.0:1789478473.180840:0:13723:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ebb03650000 uarg=0000000000000000 20000000:01000000:3.0:1789478473.180878:0:13723:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789478473.180883:0:13723:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789478473.180887:0:13723:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1789478473.184517:0:13724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789478473.184814:0:13723:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1789478473.190850:0:13723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1789478473.190888:0:13723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1789478473.190902:0:13723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1789478473.190919:0:13723:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789478473.190939:0:13723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ebc40fcfe00/0x8ebaae74e821604a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478473.190958:0:13723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc35b67400/0x8ebaae74e8215ede lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215ed7 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478473.190967:0:13723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc34f76c00/0x8ebaae74e8215eec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215ee5 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478473.190974:0:13723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc35b66600/0x8ebaae74e8215efa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215ef3 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478473.190981:0:13723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc40fcf600/0x8ebaae74e8215f08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8215f01 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478473.190990:0:13723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc40fce200/0x8ebaae74e8215f0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b723e expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478473.191015:0:13723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc40fcf400/0x8ebaae74e8215f16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7245 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478473.191023:0:13723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ebc40fcfe00/0x8ebaae74e821604a lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478473.191061:0:13723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc40fcf400/0x8ebaae74e8215f16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7245 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478473.191075:0:13723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ebc40fcf400/0x8ebaae74e8215f16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7245 expref: 12 pid: 6511 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478473.191091:0:13723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ff9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13723:1876403964444928:192.168.206.11@tcp:104: 00010000:00010000:1.0:1789478473.191259:0:13723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc40fce200/0x8ebaae74e8215f0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b723e expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478473.191268:0:13723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ebc40fce200/0x8ebaae74e8215f0f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b723e expref: 12 pid: 6511 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478473.191278:0:13723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ff9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13723:1876403964445056:192.168.206.11@tcp:104: 00010000:00010000:1.0:1789478473.191311:0:13723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc40fcf600/0x8ebaae74e8215f08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215f01 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478473.191319:0:13723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc40fcf600/0x8ebaae74e8215f08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215f01 expref: 23 pid: 6512 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478473.191328:0:13723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ffb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13723:1876403964445184:0@lo:104: 00000100:00100000:1.0:1789478473.191378:0:13723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789478473.191430:0:13723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc35b66600/0x8ebaae74e8215efa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215ef3 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478473.191438:0:13723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc35b66600/0x8ebaae74e8215efa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215ef3 expref: 23 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478473.191445:0:13723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ffaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13723:1876403964445312:0@lo:104: 00010000:00010000:1.0:1789478473.191469:0:13723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc34f76c00/0x8ebaae74e8215eec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215ee5 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478473.191475:0:13723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc34f76c00/0x8ebaae74e8215eec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215ee5 expref: 23 pid: 6511 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478473.191482:0:13723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ff9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13723:1876403964445440:0@lo:104: 00010000:00010000:1.0:1789478473.191504:0:13723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc35b67400/0x8ebaae74e8215ede lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8215ed7 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478473.191511:0:13723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ebc35b67400/0x8ebaae74e8215ede lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8215ed7 expref: 23 pid: 6511 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478473.191518:0:13723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ffbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13723:1876403964445568:0@lo:104: 00000100:00100000:1.0:1789478473.191545:0:13723:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40fdb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478473.191773:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789478473.191797:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478473.191816:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478473.191825:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478473.191833:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964445184 00000100:00100000:2.0:1789478473.191839:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964445184 00000100:00100000:2.0:1789478473.191874:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964445312 00000100:00100000:2.0:1789478473.191876:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964445312 00000100:00100000:2.0:1789478473.191885:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964445440 00000100:00100000:2.0:1789478473.191887:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964445440 00000100:00100000:2.0:1789478473.191894:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964445568 00000100:00100000:2.0:1789478473.191897:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964445568 00000100:00100000:2.0:1789478473.191908:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789478473.191917:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0363e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+6:13723:x1876403964445184:12345-0@lo:104: 00010000:00010000:2.0:1789478473.191929:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce600/0x8ebaae74e8215f01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215f08 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.192053:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789478473.192060:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0363e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+6:13723:x1876403964445184:12345-0@lo:104: Request processed in 144us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478473.192067:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789478473.192104:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789478473.192110:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+5:13723:x1876403964445312:12345-0@lo:104: 00010000:00010000:2.0:1789478473.192118:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e8215ef3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215efa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.192153:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789478473.192158:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+5:13723:x1876403964445312:12345-0@lo:104: Request processed in 49us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478473.192164:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789478473.192176:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789478473.192190:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+4:13723:x1876403964445440:12345-0@lo:104: 00010000:00010000:2.0:1789478473.192197:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67a00/0x8ebaae74e8215ee5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215eec expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.192230:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789478473.192234:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+4:13723:x1876403964445440:12345-0@lo:104: Request processed in 47us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478473.192240:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789478473.192253:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789478473.192258:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+3:13723:x1876403964445568:12345-0@lo:104: 00010000:00010000:2.0:1789478473.192265:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215ed7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215ede expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.192291:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789478473.192296:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+3:13723:x1876403964445568:12345-0@lo:104: Request processed in 38us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478473.192301:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1789478473.192315:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789478473.192321:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce600/0x8ebaae74e8215f01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215f08 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.192327:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fce600 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:2.0:1789478473.192330:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce600/0x8ebaae74e8215f01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215f08 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.192421:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce600/0x8ebaae74e8215f01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215f08 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789478473.192428:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce600/0x8ebaae74e8215f01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215f08 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478473.192440:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789478473.192466:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce600/0x8ebaae74e8215f01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215f08 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.192472:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789478473.192495:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce600/0x8ebaae74e8215f01 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215f08 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478473.192499:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1789478473.192502:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce600/0x8ebaae74e8215f01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215f08 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.192514:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789478473.192517:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e8215ef3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215efa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.192522:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77800 already unused, calling callback (ffffffffc1383c20) 00000100:00100000:3.0:1789478473.192523:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964445696:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1789478473.192525:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e8215ef3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215efa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.192531:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e8215ef3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215efa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789478473.192547:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e8215ef3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215efa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478473.192553:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789478473.192565:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e8215ef3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215efa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478473.192569:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789478473.192571:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789478473.192583:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e8215ef3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215efa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.192588:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e8215ef3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215efa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478473.192613:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964445824:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789478473.192614:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789478473.192617:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67a00/0x8ebaae74e8215ee5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215eec expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.192623:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67a00 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:2.0:1789478473.192626:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67a00/0x8ebaae74e8215ee5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215eec expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.192633:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67a00/0x8ebaae74e8215ee5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215eec expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478473.192638:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1789478473.192639:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67a00/0x8ebaae74e8215ee5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215eec expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478473.192644:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789478473.192656:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67a00/0x8ebaae74e8215ee5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215eec expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.192662:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789478473.192674:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67a00/0x8ebaae74e8215ee5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215eec expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478473.192676:0:10392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964445696 00000100:00100000:3.0:1789478473.192680:0:10392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964445696 00010000:00010000:2.0:1789478473.192681:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67a00/0x8ebaae74e8215ee5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215eec expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.192688:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478473.192696:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215ed7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8215ede expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478473.192698:0:10392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc40fcf600/0x8ebaae74e8215f08 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215f01 expref: 24 pid: 6512 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.192702:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76600 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:2.0:1789478473.192719:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215ed7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8215ede expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478473.192726:0:10392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964445824 00010000:00010000:2.0:1789478473.192726:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215ed7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8215ede expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478473.192729:0:10392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964445824 10000000:00010000:2.0:1789478473.192732:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215ed7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8215ede expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478473.192737:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789478473.192739:0:10392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc35b66600/0x8ebaae74e8215efa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215ef3 expref: 25 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.192750:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215ed7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215ede expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478473.192754:0:10392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00010000:00010000:2.0:1789478473.192755:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789478473.192759:0:10392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03784e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c56e5039-4535-4d8a-bd01-962355b55f9c+25:3648:x1876403964445696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789478473.192761:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215ed7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215ede expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.192767:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8215ed7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8215ede expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478473.192769:0:10392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478473.192773:0:10392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc40fcf600/0x8ebaae74e8215f08 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215f01 expref: 25 pid: 6512 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.192779:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478473.192780:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478473.192782:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478473.192788:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478473.192793:0:10392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc40fcf600/0x8ebaae74e8215f08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215f01 expref: 25 pid: 6512 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478473.192799:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964445952:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789478473.192807:0:10392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478473.192822:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789478473.192871:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478473.193011:0:13723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc40fcf600/0x8ebaae74e8215f08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215f01 expref: 25 pid: 6512 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478473.193021:0:13723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ffb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13723:1876403964445184:0@lo:104: 00000100:00100000:1.0:1789478473.193030:0:13723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ffaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13723:1876403964445312:0@lo:104: 00000100:00100000:1.0:1789478473.193036:0:13723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ff9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13723:1876403964445440:0@lo:104: 00000100:00100000:1.0:1789478473.193043:0:13723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ffbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13723:1876403964445568:0@lo:104: 00000100:00100000:3.0:1789478473.193285:0:10392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03784e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3648:x1876403964445696:12345-0@lo:103:ldlm_bl.0 Request processed in 524us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478473.193288:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789478473.193293:0:10392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789478473.193301:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964446080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789478473.193306:0:10392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964445952 00000100:00100000:3.0:1789478473.193309:0:10392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964445952 00010000:00010000:3.0:1789478473.193322:0:10392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc34f76c00/0x8ebaae74e8215eec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215ee5 expref: 24 pid: 6511 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478473.193323:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478473.193334:0:10392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964446080 00000100:00100000:3.0:1789478473.193336:0:10392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964446080 00010000:00010000:3.0:1789478473.193348:0:10392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc35b67400/0x8ebaae74e8215ede lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215ed7 expref: 25 pid: 6511 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478473.193360:0:10392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789478473.193372:0:10392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03785180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c56e5039-4535-4d8a-bd01-962355b55f9c+25:3648:x1876403964445824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789478473.193381:0:10392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478473.193386:0:10392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc35b66600/0x8ebaae74e8215efa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215ef3 expref: 25 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478473.193451:0:10392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc35b66600/0x8ebaae74e8215efa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215ef3 expref: 25 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478473.193465:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc35b66600/0x8ebaae74e8215efa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215ef3 expref: 25 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478473.193474:0:10392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478473.193499:0:10392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03785180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3648:x1876403964445824:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478473.193668:0:10392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789478473.193700:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789478473.193755:0:10392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789478473.193762:0:10392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c56e5039-4535-4d8a-bd01-962355b55f9c+23:3645:x1876403964446080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789478473.193771:0:10392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478473.193775:0:10392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc35b67400/0x8ebaae74e8215ede lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215ed7 expref: 23 pid: 6511 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478473.193864:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+23:3645:x1876403964445952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789478473.193873:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478473.193878:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc34f76c00/0x8ebaae74e8215eec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8215ee5 expref: 23 pid: 6511 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.193887:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc34f76c00/0x8ebaae74e8215eec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215ee5 expref: 23 pid: 6511 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.193897:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc34f76c00/0x8ebaae74e8215eec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215ee5 expref: 23 pid: 6511 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.193906:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478473.193934:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+22:3645:x1876403964445952:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478473.193940:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1789478473.193972:0:10392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc35b67400/0x8ebaae74e8215ede lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8215ed7 expref: 21 pid: 6511 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478473.193983:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc35b67400/0x8ebaae74e8215ede lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8215ed7 expref: 21 pid: 6511 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478473.193992:0:10392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478473.194009:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964445952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789478473.194014:0:10392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c56e5039-4535-4d8a-bd01-962355b55f9c+20:3645:x1876403964446080:12345-0@lo:103:ldlm_bl.0 Request processed in 254us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478473.194024:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964446080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789478473.194026:0:10392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789478473.194128:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964445824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789478473.194137:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964445696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789478473.202417:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478473.202502:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478473.202589:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945496064 00000100:00100000:3.0:1789478473.202628:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945496064 00010000:00010000:3.0:1789478473.202663:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc40fce200/0x8ebaae74e8215f0f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b723e expref: 13 pid: 6511 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478473.202701:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945496192 00000100:00100000:3.0:1789478473.202705:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945496192 00010000:00010000:3.0:1789478473.202718:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc40fcf400/0x8ebaae74e8215f16 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7245 expref: 14 pid: 6511 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478473.202737:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 50 00000100:00100000:3.0:1789478473.202796:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+14:2395:x1876403945496064:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789478473.202810:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478473.202816:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc40fce200/0x8ebaae74e8215f0f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b723e expref: 14 pid: 6511 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478473.202839:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc40fce200/0x8ebaae74e8215f0f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b723e expref: 14 pid: 6511 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478473.202860:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478473.202869:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:2.0:1789478473.202883:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+14:2396:x1876403945496192:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789478473.202892:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478473.202898:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc40fcf400/0x8ebaae74e8215f16 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7245 expref: 14 pid: 6511 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478473.202910:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+14:2395:x1876403945496064:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 162us (511us total) trans 0 rc 0/0 00010000:00010000:2.0:1789478473.202911:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc40fcf400/0x8ebaae74e8215f16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7245 expref: 14 pid: 6511 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478473.202925:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 50 00010000:00010000:2.0:1789478473.202929:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ebc40fcfe00/0x8ebaae74e821604a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.202945:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40fcfe00/0x8ebaae74e821604a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.202955:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc40fcfe00/0x8ebaae74e821604a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.202959:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc40fcfe00/0x8ebaae74e821604a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.202964:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ebc40fcfe00/0x8ebaae74e821604a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.202968:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ebc40fcfe00/0x8ebaae74e821604a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.202973:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfe00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478473.202975:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ebc40fcfe00/0x8ebaae74e821604a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.202981:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ebc40fcfe00/0x8ebaae74e821604a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.202986:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ebc40fcfe00/0x8ebaae74e821604a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.202993:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478473.203012:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2396:x1876403945496192:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 135us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478473.203017:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 51 00010000:00010000:1.0:1789478473.203083:0:13723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc40fcf400/0x8ebaae74e8215f16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7245 expref: 12 pid: 6511 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478473.203099:0:13723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ff9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13723:1876403964444928:192.168.206.11@tcp:104: 00010000:00010000:1.0:1789478473.203112:0:13723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc40fce200/0x8ebaae74e8215f0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b723e expref: 11 pid: 6511 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478473.203121:0:13723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ff9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13723:1876403964445056:192.168.206.11@tcp:104: 00010000:00010000:1.0:1789478473.203152:0:13723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ebc40fcfe00/0x8ebaae74e821604a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478473.203161:0:13723:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ebc40fcfe00/0x8ebaae74e821604a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478473.203167:0:13723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ebc40fcfe00/0x8ebaae74e821604a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478473.203173:0:13723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc40fcfe00/0x8ebaae74e821604a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478473.254194:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789478473.831942:0:13772:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd36a460c0 20000000:00000080:3.0:1789478473.831963:0:13772:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ebb03373800 uarg=0000000000000000 20000000:01000000:3.0:1789478473.832013:0:13772:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1789478473.832019:0:13772:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1789478473.832024:0:13772:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1789478473.833200:0:13773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1789478473.833446:0:13772:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1789478473.833521:0:13772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1789478473.833909:0:13772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1789478473.833934:0:13772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1789478473.833945:0:13772:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789478473.833964:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ebb035fc600/0x8ebaae74e8216051 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478473.833979:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebb035fc600/0x8ebaae74e8216051 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478473.833990:0:13772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebb035fc600/0x8ebaae74e8216051 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478473.834151:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebb035fc600/0x8ebaae74e8216051 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478473.834161:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ebb035fc600/0x8ebaae74e8216051 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478473.834169:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ebb035fc600/0x8ebaae74e8216051 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478473.834175:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fc600 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478473.834179:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ebb035fc600/0x8ebaae74e8216051 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478473.834187:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ebb035fc600/0x8ebaae74e8216051 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478473.834206:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ebb035fc600/0x8ebaae74e8216051 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478473.834722:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ebb035fc600/0x8ebaae74e8216051 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478473.834731:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebb035fc600/0x8ebaae74e8216051 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478474.239944:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478474.240026:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945496320 00000100:00100000:1.0:1789478474.240036:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945496320 00000100:00100000:1.0:1789478474.240093:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 327 00000100:00100000:1.0:1789478474.240104:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+11:6164:x1876403945496320:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789478474.240131:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478474.240150:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40fce200/0x8ebaae74e8216058 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7292 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.240192:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40fce200/0x8ebaae74e8216058 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7292 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.240203:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40fce200/0x8ebaae74e8216058 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7292 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.240212:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fce200, rc 0) 00000100:00100000:1.0:1789478474.240271:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+12:6164:x1876403945496320:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 Request processed in 168us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478474.240278:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 327 00000100:00100000:3.0:1789478474.243484:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478474.244002:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945496448 00000100:00100000:1.0:1789478474.244012:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945496448 00000100:00100000:1.0:1789478474.244074:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 328 00000100:00100000:1.0:1789478474.244085:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+12:6164:x1876403945496448:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478474.244375:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+12:6164:x1876403945496448:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 Request processed in 291us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478474.244383:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 328 00000100:00100000:0.0:1789478474.247390:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478474.247560:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945496576 00000100:00100000:2.0:1789478474.247569:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945496576 00000100:00100000:2.0:1789478474.247640:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 329 00000100:00100000:2.0:1789478474.247651:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+12:6164:x1876403945496576:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789478474.247978:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+12:6164:x1876403945496576:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 Request processed in 327us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478474.247986:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 329 00000100:00100000:0.0:1789478474.258283:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478474.259286:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945496704 00000100:00100000:3.0:1789478474.259297:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945496704 00000100:00100000:3.0:1789478474.259351:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 330 00000100:00100000:3.0:1789478474.259360:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+12:10763:x1876403945496704:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789478474.259499:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+12:10763:x1876403945496704:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 139us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478474.259507:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 330 00000100:00100000:3.0:1789478474.264373:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478474.266292:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945496832 00000100:00100000:2.0:1789478474.266305:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945496832 00000100:00100000:2.0:1789478474.266372:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 331 00000100:00100000:2.0:1789478474.266382:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+12:10763:x1876403945496832:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789478474.266555:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+12:10763:x1876403945496832:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 174us (2191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478474.266562:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 331 00010000:00010000:2.0:1789478474.280881:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478474.290946:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478474.292015:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945496960 00000100:00100000:1.0:1789478474.292027:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945496960 00000100:00100000:1.0:1789478474.292088:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 332 00000100:00100000:1.0:1789478474.292100:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+12:6164:x1876403945496960:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789478474.292122:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478474.292140:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40fcf400/0x8ebaae74e821605f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7299 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.292170:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40fcf400/0x8ebaae74e821605f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7299 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.292194:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40fcf400/0x8ebaae74e821605f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7299 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.292204:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcf400, rc 0) 00000100:00100000:1.0:1789478474.292259:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:6164:x1876403945496960:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 Request processed in 161us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478474.292266:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 332 00000100:00100000:0.0:1789478474.294839:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478474.295007:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945497088 00000100:00100000:1.0:1789478474.295016:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945497088 00000100:00100000:1.0:1789478474.295080:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 333 00000100:00100000:1.0:1789478474.295090:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:6164:x1876403945497088:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478474.295630:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:6164:x1876403945497088:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 Request processed in 539us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478474.295638:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 333 00000100:00100000:3.0:1789478474.312520:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478474.313069:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945497216 00000100:00100000:2.0:1789478474.313081:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945497216 00000100:00100000:2.0:1789478474.313163:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 334 00000100:00100000:2.0:1789478474.313174:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:6164:x1876403945497216:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789478474.313315:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:6164:x1876403945497216:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 Request processed in 142us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478474.313323:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 334 00000100:00100000:2.0:1789478474.317228:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478474.317370:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945497344 00000100:00100000:0.0:1789478474.317379:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945497344 00000100:00100000:0.0:1789478474.317431:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 335 00000100:00100000:0.0:1789478474.317441:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:10767:x1876403945497344:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789478474.317622:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:10767:x1876403945497344:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 156us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478474.317629:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 335 00000100:00100000:0.0:1789478474.322312:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478474.322453:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945497472 00000100:00100000:3.0:1789478474.322462:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945497472 00000100:00100000:3.0:1789478474.322515:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 336 00000100:00100000:3.0:1789478474.322525:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:10767:x1876403945497472:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789478474.323065:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:10767:x1876403945497472:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 539us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478474.323074:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 336 00000100:00100000:1.0:1789478474.470489:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789478474.470511:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964446208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789478474.470635:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478474.470761:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964446208 00000100:00100000:0.0:1789478474.471022:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964446208 00000100:00100000:0.0:1789478474.471090:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789478474.471101:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964446208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789478474.471133:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478474.471200:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964446208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478474.471232:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1789478474.471495:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789478474.471551:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40ecf800 x1876403964446208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478490 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478474.471569:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964446208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789478474.878041:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478474.878096:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478474.878129:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478474.878166:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945497600 00000100:00100000:2.0:1789478474.878176:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945497600 00000100:00100000:2.0:1789478474.878239:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 337 00000100:00100000:3.0:1789478474.878247:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478474.878265:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2397:x1876403945497600:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1789478474.878338:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2397:x1876403945497600:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 66us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478474.878345:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 337 00000100:00100000:0.0:1789478474.888232:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945497856 00000100:00100000:0.0:1789478474.888259:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945497856 00000100:00100000:2.0:1789478474.888281:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945498112 00000100:00100000:2.0:1789478474.888288:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945498112 00000100:00100000:0.0:1789478474.888330:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945497728 00000100:00100000:0.0:1789478474.888334:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945497728 00000100:00100000:3.0:1789478474.888380:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478474.888411:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478474.888433:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945497984 00000100:00100000:3.0:1789478474.888436:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945497984 00000100:00100000:3.0:1789478474.888466:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 84 00000100:00100000:3.0:1789478474.888475:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945497984:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478474.888546:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945497984:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 72us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478474.888554:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 84 00000100:00100000:3.0:1789478474.888574:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945498240 00000100:00100000:3.0:1789478474.888577:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945498240 00000100:00100000:2.0:1789478474.888659:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 173 00000100:00100000:2.0:1789478474.888681:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945497856:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1789478474.888713:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945497856:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 48us (10616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478474.888719:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 173 00000100:00100000:2.0:1789478474.888732:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 174 00000100:00100000:2.0:1789478474.888739:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2397:x1876403945498112:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1789478474.888759:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2397:x1876403945498112:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 22us (10630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478474.888766:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 174 00000100:00100000:0.0:1789478474.888904:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 175 00000100:00100000:0.0:1789478474.888915:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:2397:x1876403945497728:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478474.888949:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:2397:x1876403945497728:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 37us (10704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478474.888955:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 175 00000100:00080000:0.0:1789478474.888980:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789478474.888983:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789478474.888986:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789478474.890361:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 176 00000100:00100000:3.0:1789478474.890375:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2397:x1876403945498240:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478474.890425:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2397:x1876403945498240:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 54us (2013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478474.890432:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 176 00000100:00100000:1.0:1789478474.981326:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964446336:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789478474.981390:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478474.981697:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964446336 00000100:00100000:2.0:1789478474.981705:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964446336 00000100:00100000:2.0:1789478474.981775:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789478474.981785:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964446336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789478474.981806:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789478474.981851:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964446336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478474.981857:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1789478474.981892:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40ece300 x1876403964446336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478490 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478474.981916:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964446336:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789478474.981988:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789478474.988467:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1789478474.988511:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1789478474.988534:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:1.0:1789478474.988693:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfa00/0x8ebaae74e8215fa2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988706:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfa00/0x8ebaae74e8215fa2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988715:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfa00/0x8ebaae74e8215fa2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988720:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfa00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478474.988724:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfa00/0x8ebaae74e8215fa2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988731:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfa00/0x8ebaae74e8215fa2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988748:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xeb7e073f (ffff8ebc185a7400) 00010000:00010000:1.0:1789478474.988751:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478474.988755:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfa00/0x8ebaae74e8215fa2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988762:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfa00/0x8ebaae74e8215fa2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988778:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8215fb7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988784:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8215fb7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988790:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8215fb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988809:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478474.988812:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8215fb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988819:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8215fb7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988828:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ebb02275a00) 00010000:00010000:1.0:1789478474.988830:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478474.988834:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8215fb7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988839:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8215fb7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988857:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8216020 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988863:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8216020 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988869:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8216020 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988875:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcf000 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478474.988878:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8216020 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988884:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8216020 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988902:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xeb7e073f (ffff8ebc185a7400) 00010000:00010000:1.0:1789478474.988905:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478474.988908:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8216020 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988914:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf000/0x8ebaae74e8216020 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xeb7e073f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988927:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc00030a00/0x8ebaae74e821603c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988934:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc00030a00/0x8ebaae74e821603c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988940:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc00030a00/0x8ebaae74e821603c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988945:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc00030a00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478474.988948:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc00030a00/0x8ebaae74e821603c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988954:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc00030a00/0x8ebaae74e821603c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988962:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ebc185a7c00) 00010000:00010000:1.0:1789478474.988964:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478474.988967:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc00030a00/0x8ebaae74e821603c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.988973:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc00030a00/0x8ebaae74e821603c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478474.989373:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789478474.989464:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964446464:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789478474.989534:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478474.989786:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964446464 00000100:00100000:1.0:1789478474.989794:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964446464 00000100:00100000:1.0:1789478474.989920:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789478474.989930:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964446464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789478474.989953:0:8829:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1789478474.989983:0:8829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa94644, atime: 0x6aa94644, ctime: 0x6aa94644, blocks: 0x0 00010000:00010000:1.0:1789478474.989991:0:8829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099df6d00/0x8ebaae74e8216066 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.990005:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=304s v=(0 0) 00010000:00010000:1.0:1789478474.990010:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478474.990017:0:8829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099df6d00/0x8ebaae74e8216066 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.990044:0:8829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099df6d00/0x8ebaae74e8216066 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.990054:0:8829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099df6d00/0x8ebaae74e8216066 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.990062:0:8829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099df6d00/0x8ebaae74e8216066 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478474.990086:0:8829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789478474.990218:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1876403964446464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 289us (693us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789478474.990236:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1789478474.990283:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478474.990290:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099df6d00/0x8ebaae74e8216066 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478474.990299:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfc00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478474.990303:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099df6d00/0x8ebaae74e8216066 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478474.990312:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099df6d00/0x8ebaae74e8216066 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478474.990328:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099df6d00/0x8ebaae74e8216066 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478474.990336:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099df6d00/0x8ebaae74e8216066 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478474.990353:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478474.990355:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478474.990356:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789478474.990383:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789478474.990455:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ebb03c1f480/2, rc 0, transno 4294967301 00000100:00100000:3.0:1789478474.990467:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964446464:0@lo:6:osp-syn-1-0.0 10000000:01000000:0.0:1789478475.044699:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789478475.044706:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebc3f6c1800 from 7 10000000:01000000:0.0:1789478475.044711:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789478475.044756:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67600/0x8ebaae74e821606d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478475.044768:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67600/0x8ebaae74e821606d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478475.044778:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67600/0x8ebaae74e821606d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478475.044800:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964446592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789478475.044861:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478475.044908:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02afb240 going to sleep for 11 seconds 00000100:00100000:1.0:1789478475.044986:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964446592 00000100:00100000:1.0:1789478475.044993:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964446592 00000100:00100000:1.0:1789478475.045049:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789478475.045059:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+20:6514:x1876403964446592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789478475.045071:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478475.045084:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40fcf000/0x8ebaae74e8216074 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e821606d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478475.045106:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40fcf000/0x8ebaae74e8216074 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e821606d expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478475.045116:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40fcf000/0x8ebaae74e8216074 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e821606d expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478475.045125:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcf000, rc 0) 00000100:00100000:1.0:1789478475.045184:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964446592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478475.045190:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1789478475.045737:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964446592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789478475.045752:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67600/0x8ebaae74e821606d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216074 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478475.045771:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67600/0x8ebaae74e821606d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8216074 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478475.045829:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964446720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789478475.045856:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478475.045883:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02afb240 going to sleep for 11 seconds 00000100:00100000:2.0:1789478475.046667:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964446720 00000100:00100000:2.0:1789478475.046676:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964446720 00000100:00100000:2.0:1789478475.046785:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789478475.046794:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964446720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789478475.047384:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964446720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 588us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478475.047411:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1789478475.047514:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964446720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789478475.047564:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964446848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789478475.047620:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478475.051253:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964446848 00000100:00100000:1.0:1789478475.051265:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964446848 00000100:00100000:0.0:1789478475.051300:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02afb240 going to sleep for 11 seconds 00000100:00100000:1.0:1789478475.051316:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1789478475.051326:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964446848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789478475.051538:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964446848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (3916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478475.051546:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1789478475.052115:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964446848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789478475.052928:0:13786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:13786:1876403964446976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789478475.053048:0:13786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478475.053158:0:13786:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02afb540 going to sleep for 11 seconds 00000100:00100000:1.0:1789478475.053247:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964446976 00000100:00100000:1.0:1789478475.053259:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964446976 00000100:00100000:1.0:1789478475.053304:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1789478475.053312:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+21:13786:x1876403964446976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789478475.053409:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+21:13786:x1876403964446976:12345-0@lo:502:llog_process_th.0 Request processed in 97us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478475.053417:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1789478475.053440:0:13786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:13786:1876403964446976:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789478475.053462:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789478475.053471:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478475.053473:0:13786:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789478475.053489:0:13786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ebc3f6c1800 00000020:00000080:0.0:1789478475.053492:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789478475.053553:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789478475.053558:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478475.053560:0:13786:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789478475.053563:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789478475.053565:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478475.053573:0:13786:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789478475.053578:0:13786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ebc3f6c1800 00000020:00000080:0.0:1789478475.053580:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789478475.053656:0:13786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:13786:1876403964447104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789478475.053690:0:13786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478475.053709:0:13786:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02afb540 going to sleep for 11 seconds 00000100:00100000:1.0:1789478475.053850:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964447104 00000100:00100000:1.0:1789478475.053856:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964447104 00000100:00100000:1.0:1789478475.053885:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789478475.053900:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+21:13786:x1876403964447104:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789478475.053967:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+21:13786:x1876403964447104:12345-0@lo:502:llog_process_th.0 Request processed in 74us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478475.053974:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1789478475.054048:0:13786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:13786:1876403964447104:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789478475.054132:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789478475.054136:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478475.054138:0:13786:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789478475.054141:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789478475.054305:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1789478475.054325:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789478475.054335:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67600/0x8ebaae74e821606d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216074 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478475.054345:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67600/0x8ebaae74e821606d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216074 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478475.054355:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789478475.054358:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebc40e0d800 from 7 10000000:01000000:3.0:1789478475.054361:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789478475.054384:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc600/0x8ebaae74e821607b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478475.054392:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc600/0x8ebaae74e821607b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478475.054401:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc600/0x8ebaae74e821607b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478475.054415:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964447232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789478475.054447:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478475.054474:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc07a94c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789478475.054560:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964447232 00000100:00100000:1.0:1789478475.054565:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964447232 00000100:00100000:1.0:1789478475.054625:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1789478475.054633:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+21:6514:x1876403964447232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789478475.054642:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478475.054655:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40fcfa00/0x8ebaae74e8216082 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e821607b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478475.054675:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40fcfa00/0x8ebaae74e8216082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e821607b expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478475.054685:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40fcfa00/0x8ebaae74e8216082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e821607b expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478475.054693:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcfa00, rc 0) 00000100:00100000:1.0:1789478475.055110:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964447232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 476us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478475.055111:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964447232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789478475.055123:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00010000:00010000:0.0:1789478475.055129:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc600/0x8ebaae74e821607b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216082 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478475.055141:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc600/0x8ebaae74e821607b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8216082 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478475.055299:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964447360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789478475.055326:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478475.055399:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964447360 00000100:00100000:1.0:1789478475.055403:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964447360 00000100:00100000:0.0:1789478475.055420:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02afb540 going to sleep for 11 seconds 00000100:00100000:1.0:1789478475.055438:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1789478475.055448:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964447360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789478475.055834:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964447360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478475.055836:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964447360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 388us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478475.055848:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1789478475.055868:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964447488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789478475.055908:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478475.055934:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02afb540 going to sleep for 11 seconds 00000100:00100000:1.0:1789478475.055982:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964447488 00000100:00100000:1.0:1789478475.055987:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964447488 00000100:00100000:1.0:1789478475.056019:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1789478475.056026:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964447488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789478475.056490:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964447488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 464us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478475.056497:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789478475.056586:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964447488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789478475.057240:0:13787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ffbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:13787:1876403964447616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789478475.057279:0:13787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478475.057314:0:13787:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40fdb180 going to sleep for 11 seconds 00000100:00100000:3.0:1789478475.057561:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964447616 00000100:00100000:3.0:1789478475.057569:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964447616 00000100:00100000:3.0:1789478475.057632:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1789478475.057642:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+22:13787:x1876403964447616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789478475.057727:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+22:13787:x1876403964447616:12345-0@lo:502:llog_process_th.0 Request processed in 87us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478475.057742:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1789478475.057873:0:13787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ffbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:13787:1876403964447616:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789478475.057894:0:13787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789478475.057903:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478475.057905:0:13787:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789478475.057911:0:13787:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ebc40e0d800 00000020:00000080:1.0:1789478475.057914:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789478475.057960:0:13787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789478475.057963:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478475.057964:0:13787:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789478475.057967:0:13787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789478475.057969:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478475.057970:0:13787:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789478475.057973:0:13787:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ebc40e0d800 00000020:00000080:1.0:1789478475.057975:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789478475.058005:0:13787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ffbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:13787:1876403964447744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789478475.058037:0:13787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478475.058072:0:13787:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40fdb180 going to sleep for 11 seconds 00000100:00100000:3.0:1789478475.058637:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964447744 00000100:00100000:3.0:1789478475.058642:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964447744 00000100:00100000:3.0:1789478475.058665:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1789478475.058670:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+22:13787:x1876403964447744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789478475.058731:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+22:13787:x1876403964447744:12345-0@lo:502:llog_process_th.0 Request processed in 60us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478475.058736:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789478475.058918:0:13787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ffbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:13787:1876403964447744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789478475.058938:0:13787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789478475.058943:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478475.058945:0:13787:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789478475.058949:0:13787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789478475.059717:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1789478475.059740:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789478475.059750:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc600/0x8ebaae74e821607b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216082 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478475.059761:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc600/0x8ebaae74e821607b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216082 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478475.059772:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789478475.059774:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebc34d64800 from 7 10000000:01000000:3.0:1789478475.059777:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789478475.059805:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216089 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478475.059813:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216089 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478475.059823:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216089 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478475.059841:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964447872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789478475.059888:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478475.059919:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc07a94600 going to sleep for 11 seconds 00000100:00100000:0.0:1789478475.059980:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964447872 00000100:00100000:0.0:1789478475.059985:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964447872 00000100:00100000:0.0:1789478475.060021:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1789478475.060030:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+22:6514:x1876403964447872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789478475.060041:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478475.060054:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc35b67200/0x8ebaae74e8216090 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8216089 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478475.060084:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc35b67200/0x8ebaae74e8216090 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8216089 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478475.060094:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc35b67200/0x8ebaae74e8216090 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8216089 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478475.060372:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b67200, rc 0) 00000100:00100000:0.0:1789478475.060455:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964447872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 426us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478475.060462:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1789478475.060520:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964447872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789478475.060546:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216089 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216090 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478475.060556:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216089 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8216090 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478475.060754:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964448000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789478475.060785:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478475.060852:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc07a94600 going to sleep for 11 seconds 00000100:00100000:1.0:1789478475.060883:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964448000 00000100:00100000:1.0:1789478475.060888:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964448000 00000100:00100000:1.0:1789478475.060951:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1789478475.060960:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964448000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478475.061077:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964448000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478475.061085:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789478475.061204:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964448000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789478475.061238:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964448128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789478475.061272:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478475.061344:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02afb780 going to sleep for 11 seconds 00000100:00100000:3.0:1789478475.061345:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964448128 00000100:00100000:3.0:1789478475.061349:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964448128 00000100:00100000:3.0:1789478475.061379:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1789478475.061384:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964448128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789478475.061443:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964448128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 58us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478475.061449:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789478475.061463:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964448128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789478475.062218:0:13789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ff9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:13789:1876403964448256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789478475.062255:0:13789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478475.062619:0:13789:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40fdb180 going to sleep for 11 seconds 00000100:00100000:3.0:1789478475.062890:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964448256 00000100:00100000:3.0:1789478475.062896:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964448256 00000100:00100000:3.0:1789478475.062932:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1789478475.062939:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+23:13789:x1876403964448256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789478475.063333:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+23:13789:x1876403964448256:12345-0@lo:502:llog_process_th.0 Request processed in 393us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478475.063341:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1789478475.063548:0:13789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ff9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:13789:1876403964448256:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789478475.063574:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789478475.063582:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478475.063585:0:13789:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789478475.063645:0:13789:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ebc34d64800 00000020:00000080:1.0:1789478475.063650:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789478475.063693:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789478475.063701:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478475.063703:0:13789:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789478475.063705:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789478475.063708:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478475.063709:0:13789:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789478475.063712:0:13789:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ebc34d64800 00000020:00000080:1.0:1789478475.063714:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789478475.063748:0:13789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ff9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:13789:1876403964448384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789478475.063786:0:13789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478475.063813:0:13789:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40fdb180 going to sleep for 11 seconds 00000100:00100000:3.0:1789478475.064161:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964448384 00000100:00100000:3.0:1789478475.064167:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964448384 00000100:00100000:3.0:1789478475.064239:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1789478475.064248:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+23:13789:x1876403964448384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789478475.064354:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+23:13789:x1876403964448384:12345-0@lo:502:llog_process_th.0 Request processed in 107us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478475.064360:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789478475.064429:0:13789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ff9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:13789:1876403964448384:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789478475.064446:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789478475.064450:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478475.064452:0:13789:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789478475.064455:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789478475.065614:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789478475.065637:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789478475.065646:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216089 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216090 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478475.065658:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216089 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216090 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478475.065668:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789478475.065670:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebc0501d800 from 7 10000000:01000000:0.0:1789478475.065673:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789478475.065700:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8216097 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478475.065707:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8216097 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478475.065715:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8216097 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478475.065731:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964448512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789478475.065771:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478475.066064:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964448512 00000100:00100000:3.0:1789478475.066071:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964448512 00000100:00100000:0.0:1789478475.066168:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34ef7780 going to sleep for 11 seconds 00000100:00100000:3.0:1789478475.066205:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1789478475.066215:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+23:6514:x1876403964448512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789478475.066373:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478475.066388:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebb035fc800/0x8ebaae74e821609e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8216097 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478475.066411:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebb035fc800/0x8ebaae74e821609e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8216097 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478475.066421:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebb035fc800/0x8ebaae74e821609e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8216097 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478475.066430:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fc800, rc 0) 00000100:00100000:3.0:1789478475.066557:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:6514:x1876403964448512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 343us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478475.066565:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1789478475.066684:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964448512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789478475.066698:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8216097 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e821609e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478475.066708:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8216097 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e821609e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478475.066771:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964448640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789478475.066799:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478475.066829:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34ef7780 going to sleep for 11 seconds 00000100:00100000:3.0:1789478475.067051:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964448640 00000100:00100000:3.0:1789478475.067056:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964448640 00000100:00100000:3.0:1789478475.067086:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1789478475.067094:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10002850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:6514:x1876403964448640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789478475.067306:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10002850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:6514:x1876403964448640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 212us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478475.067313:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1789478475.067381:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964448640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789478475.067409:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964448768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789478475.067446:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478475.067554:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34ef7780 going to sleep for 11 seconds 00000100:00100000:3.0:1789478475.067625:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964448768 00000100:00100000:3.0:1789478475.067629:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964448768 00000100:00100000:3.0:1789478475.067653:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1789478475.067660:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10001050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:6514:x1876403964448768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789478475.067733:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10001050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:6514:x1876403964448768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478475.067740:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1789478475.067835:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c56e5039-4535-4d8a-bd01-962355b55f9c:6514:1876403964448768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789478475.069363:0:13790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:13790:1876403964448896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789478475.069423:0:13790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478475.069473:0:13790:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34ef7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789478475.069586:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964448896 00000100:00100000:3.0:1789478475.069620:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964448896 00000100:00100000:3.0:1789478475.069658:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1789478475.069666:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:13790:x1876403964448896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789478475.069765:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:13790:x1876403964448896:12345-0@lo:502:llog_process_th.0 Request processed in 100us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478475.069773:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1789478475.069860:0:13790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:13790:1876403964448896:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789478475.069883:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789478475.069891:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478475.069893:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789478475.069899:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ebc0501d800 00000020:00000080:0.0:1789478475.069901:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789478475.069944:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789478475.069947:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478475.069948:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789478475.069951:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789478475.069953:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478475.069954:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789478475.069958:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ebc0501d800 00000020:00000080:0.0:1789478475.069960:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789478475.070101:0:13790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:13790:1876403964449024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789478475.070134:0:13790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478475.070162:0:13790:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02afb780 going to sleep for 11 seconds 00000100:00100000:3.0:1789478475.070201:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964449024 00000100:00100000:3.0:1789478475.070205:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964449024 00000100:00100000:3.0:1789478475.070235:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789478475.070242:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:13790:x1876403964449024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789478475.070306:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:13790:x1876403964449024:12345-0@lo:502:llog_process_th.0 Request processed in 64us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478475.070312:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1789478475.070375:0:13790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c56e5039-4535-4d8a-bd01-962355b55f9c:13790:1876403964449024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789478475.070388:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789478475.070392:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478475.070393:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789478475.070395:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789478475.070625:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1789478475.070643:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789478475.070657:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8216097 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e821609e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478475.070667:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8216097 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e821609e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789478475.099029:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789478475.117211:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789478475.300817:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789478476.133325:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789478476.134228:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789478476.325050:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478476.516797:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789478476.516817:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964449152:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789478476.516876:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478476.516924:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964449152 00000100:00100000:0.0:1789478476.516931:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964449152 00000100:00100000:0.0:1789478476.516988:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789478476.517006:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964449152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789478476.517039:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789478476.517083:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964449152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478476.517091:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789478476.517129:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964449152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789478476.517537:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876403964449408:0@lo:400:kworker.0 00000100:00100000:2.0:1789478476.517572:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478476.517741:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964449280:0@lo:400:kworker.0 00000100:00100000:3.0:1789478476.517776:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964449536:0@lo:400:kworker.0 00000100:00100000:0.0:1789478476.517777:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478476.517816:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964449792:0@lo:400:kworker.0 00000100:00100000:3.0:1789478476.517822:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478476.517850:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964450048:0@lo:400:kworker.0 00000100:00100000:0.0:1789478476.517855:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964449280 00000100:00100000:0.0:1789478476.517872:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964449280 00000100:00100000:3.0:1789478476.517881:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478476.517903:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964450560:0@lo:400:kworker.0 00000100:00100000:0.0:1789478476.517912:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1789478476.517921:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964449280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478476.517941:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478476.517966:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789478476.517973:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964449664:0@lo:400:kworker.0 00000100:00100000:0.0:1789478476.517982:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964449280:12345-0@lo:400:kworker.0 Request processed in 63us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478476.517990:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1789478476.518005:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964450048 00000100:00100000:3.0:1789478476.518011:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964450048 00000100:00100000:0.0:1789478476.518053:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964450560 00000100:00100000:3.0:1789478476.518058:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789478476.518060:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964450560 00000100:00100000:3.0:1789478476.518069:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964450048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478476.518091:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789478476.518100:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964450560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478476.518129:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964450048:12345-0@lo:400:kworker.0 Request processed in 49us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478476.518139:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789478476.518140:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964450560:12345-0@lo:400:kworker.0 Request processed in 40us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478476.518149:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1789478476.518162:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789478476.518167:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789478476.518363:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876403964449920:0@lo:400:kworker.0 00000100:00100000:2.0:1789478476.518388:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478476.518406:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876403964450432:0@lo:400:kworker.0 00000100:00100000:2.0:1789478476.518426:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478476.518446:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789478476.518451:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964450816:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789478476.518469:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478476.518524:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964449408 00000100:00100000:2.0:1789478476.518529:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964449408 00000100:00100000:2.0:1789478476.518556:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964449920 00000100:00100000:2.0:1789478476.518559:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964449920 00000100:00080000:3.0:1789478476.518584:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789478476.518693:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478476.518717:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964450176:0@lo:400:kworker.0 00000100:00100000:2.0:1789478476.518728:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964450432 00000100:00100000:2.0:1789478476.518733:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964450432 00000100:00100000:2.0:1789478476.518755:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964449664 00000100:00100000:2.0:1789478476.518758:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964449664 00000100:00100000:2.0:1789478476.518770:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789478476.518776:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876403964449408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478476.518816:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478476.518823:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876403964449408:12345-0@lo:400:kworker.0 Request processed in 46us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478476.518833:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789478476.518852:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964450688:0@lo:400:kworker.0 00000100:00100000:2.0:1789478476.518858:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789478476.518867:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876403964449920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478476.518884:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478476.518910:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876403964449920:12345-0@lo:400:kworker.0 Request processed in 44us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478476.518917:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00010000:00080000:3.0:1789478476.518921:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc34cb6300 x1876403964450048/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478476.518933:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789478476.519190:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964450048:0@lo:400:kworker.0 00000100:00100000:3.0:1789478476.519209:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964450560:0@lo:400:kworker.0 00000100:00080000:3.0:1789478476.519236:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789478476.519293:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876403964450432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478476.519297:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964450176 00000100:00100000:3.0:1789478476.519303:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964450176 00000100:00100000:2.0:1789478476.519335:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876403964450432:12345-0@lo:400:kworker.0 Request processed in 395us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478476.519338:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964450688 00000100:00100000:3.0:1789478476.519343:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964450688 00000100:00100000:2.0:1789478476.519345:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789478476.519362:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789478476.519376:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789478476.519385:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964449664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478476.519417:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964449664:12345-0@lo:400:kworker.0 Request processed in 34us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478476.519423:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789478476.519448:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478476.519469:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876403964450304:0@lo:400:kworker.0 00000100:00100000:1.0:1789478476.520230:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964449536 00000100:00100000:1.0:1789478476.520236:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964449536 00000100:00100000:1.0:1789478476.520269:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964450816 00000100:00100000:1.0:1789478476.520273:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964450816 00000100:00100000:1.0:1789478476.520286:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789478476.520293:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1876403964449536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478476.520336:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1876403964449536:12345-0@lo:400:kworker.0 Request processed in 43us (2514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478476.520343:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789478476.520355:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789478476.520361:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964450816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789478476.520382:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789478476.520411:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964450816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (1939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478476.520427:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789478476.520448:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789478476.520455:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cb75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1876403964450688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478476.520485:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cb75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1876403964450688:12345-0@lo:400:kworker.0 Request processed in 31us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478476.520490:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789478476.520535:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964449792 00000100:00100000:1.0:1789478476.520539:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964449792 00000100:00100000:3.0:1789478476.520569:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964450176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478476.520570:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789478476.520720:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964449792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478476.520773:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478476.520831:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964450304 00000100:00100000:0.0:1789478476.520836:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964450304 00000100:00100000:0.0:1789478476.520856:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789478476.520862:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876403964450304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478476.525742:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964449792:12345-0@lo:400:kworker.0 Request processed in 5018us (6284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478476.525755:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789478476.525882:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964450816:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478476.525899:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876403964449408:0@lo:400:kworker.0 00010000:00080000:1.0:1789478476.525913:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c1c000 x1876403964449920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478476.525923:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876403964449920:0@lo:400:kworker.0 00010000:00080000:1.0:1789478476.525935:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc34cb6a00 x1876403964450432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478476.525943:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876403964450432:0@lo:400:kworker.0 00000100:00080000:1.0:1789478476.525991:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789478476.525996:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789478476.526010:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789478476.526043:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964449664:0@lo:400:kworker.0 00000100:00100000:1.0:1789478476.526056:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964450688:0@lo:400:kworker.0 00000100:00100000:1.0:1789478476.526064:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964449536:0@lo:400:kworker.0 00000100:00100000:2.0:1789478476.532300:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964449280:0@lo:400:kworker.0 00000100:00100000:2.0:1789478476.532322:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964449792:0@lo:400:kworker.0 00010000:00080000:1.0:1789478476.533992:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc34cb5f80 x1876403964450176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478476.534010:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964450176:0@lo:400:kworker.0 00000100:00100000:3.0:1789478476.542220:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964450176:12345-0@lo:400:kworker.0 Request processed in 22841us (23396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478476.542235:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789478476.542327:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876403964450304:12345-0@lo:400:kworker.0 Request processed in 21461us (22831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478476.542337:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789478476.542687:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876403964450304:0@lo:400:kworker.0 00000100:00100000:0.0:1789478477.028858:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34c98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964451072:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789478477.028924:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478477.029078:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789478477.029090:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964450944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789478477.029117:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478477.029242:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964451072 00000100:00100000:0.0:1789478477.029250:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964451072 00000100:00100000:0.0:1789478477.029377:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964450944 00000100:00100000:0.0:1789478477.029382:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964450944 00000100:00100000:0.0:1789478477.029399:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789478477.029407:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964451072:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789478477.029505:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789478477.029525:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876403964450944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789478477.029546:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789478477.029612:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876403964450944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478477.029618:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789478477.029657:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964450944:0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789478477.029824:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478477.030250:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964451072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 842us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478477.030257:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789478477.032939:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34c98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964451072:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789478477.350983:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478478.374025:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478479.396734:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478479.589224:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789478479.589244:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964451200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789478479.589306:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478479.589417:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964451200 00000100:00100000:0.0:1789478479.589425:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964451200 00000100:00100000:0.0:1789478479.589490:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789478479.589511:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964451200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789478479.589537:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478479.589580:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964451200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478479.589586:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:0.0:1789478479.589647:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40ece300 x1876403964451200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478495 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478479.589664:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964451200:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789478479.589875:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789478479.998341:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478479.998514:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945498368 00000100:00100000:3.0:1789478479.998523:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945498368 00000100:00100000:3.0:1789478479.998569:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 359 00000100:00100000:3.0:1789478479.998577:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2398:x1876403945498368:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478479.998662:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2398:x1876403945498368:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 86us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478479.998683:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 359 00000100:00100000:3.0:1789478480.006958:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478480.007014:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478480.007046:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478480.007076:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478480.007095:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478480.007281:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945498496 00000100:00100000:1.0:1789478480.007291:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945498496 00000100:00100000:1.0:1789478480.007377:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945498624 00000100:00100000:1.0:1789478480.007380:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945498624 00000100:00100000:1.0:1789478480.007395:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945498880 00000100:00100000:1.0:1789478480.007397:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945498880 00000100:00100000:1.0:1789478480.007411:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945499008 00000100:00100000:1.0:1789478480.007414:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945499008 00000100:00100000:1.0:1789478480.007430:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 183 00000100:00100000:1.0:1789478480.007440:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945498496:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478480.007519:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945498496:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 80us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478480.007527:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 183 00000100:00100000:1.0:1789478480.007544:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 184 00000100:00100000:1.0:1789478480.007551:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945498624:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478480.007578:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945498624:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 27us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478480.007584:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 184 00000100:00100000:1.0:1789478480.007655:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 185 00000100:00100000:1.0:1789478480.007662:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2397:x1876403945498880:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478480.007689:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2397:x1876403945498880:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 28us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478480.007696:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 185 00000100:00100000:1.0:1789478480.007706:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 186 00000100:00100000:1.0:1789478480.007712:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2397:x1876403945499008:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478480.007733:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2397:x1876403945499008:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 20us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478480.007739:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 186 00000100:00100000:0.0:1789478480.008509:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945498752 00000100:00100000:0.0:1789478480.008517:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945498752 00000100:00100000:0.0:1789478480.008559:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 89 00000100:00100000:0.0:1789478480.008566:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945498752:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478480.008623:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945498752:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 57us (1575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478480.008629:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 89 00000100:00080000:3.0:1789478480.008753:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789478480.008757:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789478480.008760:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789478480.101010:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789478480.101032:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964451328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789478480.101097:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478480.102635:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964451328 00000100:00100000:3.0:1789478480.102653:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964451328 00000100:00100000:3.0:1789478480.102729:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789478480.102740:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964451328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789478480.102763:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478480.102826:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964451328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (1728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478480.102833:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:3.0:1789478480.102873:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40ece300 x1876403964451328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478480.102890:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964451328:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789478480.103230:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789478480.420965:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789478480.614678:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:2.0:1789478481.448374:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478481.637281:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789478481.637304:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964451456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789478481.637364:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478481.637615:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964451584:0@lo:400:kworker.0 00000100:00100000:2.0:1789478481.637647:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478481.637677:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964452096:0@lo:400:kworker.0 00000100:00100000:2.0:1789478481.637700:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478481.637715:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964452608:0@lo:400:kworker.0 00000100:00100000:2.0:1789478481.637734:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478481.637749:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789478481.637754:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964451712:0@lo:400:kworker.0 00000100:00100000:2.0:1789478481.637771:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478481.637783:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964452224:0@lo:400:kworker.0 00000100:00100000:2.0:1789478481.637801:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478481.637833:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876403964452736:0@lo:400:kworker.0 00000100:00100000:2.0:1789478481.637854:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478481.637879:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964452096 00000100:00100000:2.0:1789478481.637885:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964452096 00000100:00100000:2.0:1789478481.637924:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964452608 00000100:00100000:2.0:1789478481.637928:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964452608 00000100:00100000:2.0:1789478481.637940:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964451712 00000100:00100000:2.0:1789478481.637942:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964451712 00000100:00100000:2.0:1789478481.637951:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964452224 00000100:00100000:2.0:1789478481.637953:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964452224 00000100:00100000:2.0:1789478481.637963:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964452736 00000100:00100000:2.0:1789478481.637965:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964452736 00000100:00100000:2.0:1789478481.637979:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789478481.637986:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964452096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478481.638032:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964452096:12345-0@lo:400:kworker.0 Request processed in 46us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478481.638039:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789478481.638055:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789478481.638062:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964452608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478481.638087:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964452608:12345-0@lo:400:kworker.0 Request processed in 26us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478481.638092:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789478481.638103:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789478481.638108:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964451712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478481.638132:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964451712:12345-0@lo:400:kworker.0 Request processed in 25us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478481.638138:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789478481.638148:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789478481.638160:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964452224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478481.638188:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964452224:12345-0@lo:400:kworker.0 Request processed in 29us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478481.638193:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789478481.638204:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789478481.638211:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876403964452736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478481.638235:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876403964452736:12345-0@lo:400:kworker.0 Request processed in 25us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478481.638241:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789478481.638272:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964451712:0@lo:400:kworker.0 00010000:00080000:2.0:1789478481.638284:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb01b72a00 x1876403964452224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478481.638293:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964452224:0@lo:400:kworker.0 00010000:00080000:2.0:1789478481.638303:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03598700 x1876403964452736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478481.641264:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964451584 00000100:00100000:0.0:1789478481.641279:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964451584 00000100:00100000:0.0:1789478481.641333:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1789478481.641344:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3645:x1876403964451584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478481.641420:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3645:x1876403964451584:12345-0@lo:400:kworker.0 Request processed in 78us (3771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478481.641427:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1789478481.641564:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964451840:0@lo:400:kworker.0 00000100:00100000:0.0:1789478481.641615:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478481.641637:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964452352:0@lo:400:kworker.0 00000100:00100000:0.0:1789478481.641656:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478481.641668:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964452864:0@lo:400:kworker.0 00000100:00100000:0.0:1789478481.641683:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478481.641698:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789478481.641704:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964451968:0@lo:400:kworker.0 00000100:00100000:0.0:1789478481.641721:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478481.641739:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964451968 00000100:00100000:0.0:1789478481.641742:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964451968 00000100:00100000:0.0:1789478481.641760:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789478481.641766:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0359a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964451968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478481.641791:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0359a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964451968:12345-0@lo:400:kworker.0 Request processed in 26us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478481.641797:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789478481.641824:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964451968:0@lo:400:kworker.0 00000100:00100000:0.0:1789478481.641830:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964452480:0@lo:400:kworker.0 00000100:00100000:0.0:1789478481.641858:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478481.641875:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964452352 00000100:00100000:0.0:1789478481.641878:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964452352 00000100:00100000:0.0:1789478481.641895:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964452864 00000100:00100000:0.0:1789478481.641897:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964452864 00000100:00100000:0.0:1789478481.641909:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964452480 00000100:00100000:0.0:1789478481.641918:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964452480 00000100:00100000:0.0:1789478481.641934:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789478481.641939:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964452352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478481.641963:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964452352:12345-0@lo:400:kworker.0 Request processed in 24us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478481.641969:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789478481.641978:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789478481.641990:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0359a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964452864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478481.642011:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0359a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964452864:12345-0@lo:400:kworker.0 Request processed in 24us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478481.642016:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789478481.642024:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789478481.642028:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964452480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478481.642047:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964452480:12345-0@lo:400:kworker.0 Request processed in 19us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478481.642052:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:0.0:1789478481.642072:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb01b71500 x1876403964452480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478481.642082:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964452480:0@lo:400:kworker.0 00000100:00100000:0.0:1789478481.642088:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964452992:0@lo:400:kworker.0 00000100:00100000:0.0:1789478481.642113:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478481.642129:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964452992 00000100:00100000:0.0:1789478481.642131:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964452992 00000100:00100000:0.0:1789478481.642146:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789478481.642150:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03676a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964452992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478481.642171:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03676a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964452992:12345-0@lo:400:kworker.0 Request processed in 21us (57us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478481.642177:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789478481.642193:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1789478481.642197:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ebb03c1f480, transno 4294967301 00000100:00100000:0.0:1789478481.642206:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964452992:0@lo:400:kworker.0 00010000:00080000:0.0:1789478481.642308:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb01b70a80 x1876403964452352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478481.642317:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964452352:0@lo:400:kworker.0 00000100:00100000:0.0:1789478481.642326:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964452864:0@lo:400:kworker.0 00000100:00100000:2.0:1789478481.642421:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876403964452736:0@lo:400:kworker.0 00000100:00100000:2.0:1789478481.642437:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964451584:0@lo:400:kworker.0 00000100:00100000:2.0:1789478481.642448:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964452096:0@lo:400:kworker.0 00000100:00100000:2.0:1789478481.642458:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964452608:0@lo:400:kworker.0 00000100:00100000:1.0:1789478481.642573:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964451456 00000100:00100000:1.0:1789478481.642577:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964451456 00000100:00100000:1.0:1789478481.642620:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964451840 00000100:00100000:1.0:1789478481.642622:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964451840 00000100:00100000:1.0:1789478481.642633:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789478481.642639:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964451456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789478481.642661:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789478481.642695:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964451456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (5331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478481.642700:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789478481.642711:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789478481.642716:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0359b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964451840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478481.642745:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0359b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964451840:12345-0@lo:400:kworker.0 Request processed in 29us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478481.642751:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1789478481.642773:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789478481.642776:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789478481.642778:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789478481.642780:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789478481.642815:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964451840:0@lo:400:kworker.0 00000100:00100000:1.0:1789478481.642829:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964451456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789478481.643766:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789478481.643779:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964453120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478481.643816:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478481.643889:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964453120 00000100:00100000:3.0:1789478481.643894:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964453120 00000100:00100000:3.0:1789478481.643930:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789478481.643938:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964453120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789478481.643958:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789478481.644006:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964453120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478481.644021:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789478481.644161:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964453120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478482.149052:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789478482.149071:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964453248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789478482.149126:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478482.149158:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964453248 00000100:00100000:1.0:1789478482.149164:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964453248 00000100:00100000:1.0:1789478482.149198:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789478482.149205:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964453248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789478482.149229:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789478482.149273:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964453248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478482.149280:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789478482.149317:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964453248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789478482.149699:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789478482.149707:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964453376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789478482.149731:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478482.149764:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964453376 00000100:00100000:3.0:1789478482.149767:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964453376 00000100:00100000:3.0:1789478482.149802:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789478482.149807:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964453376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789478482.149817:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478482.149841:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964453376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478482.149847:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789478482.149870:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964453376:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789478482.468763:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478483.492814:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478484.516765:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478484.709007:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964453504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789478484.709190:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478484.712251:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964453504 00000100:00100000:0.0:1789478484.712265:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964453504 00000100:00100000:0.0:1789478484.712488:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789478484.712500:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964453504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789478484.712529:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478484.712818:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964453504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 320us (3627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478484.712825:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1789478484.712919:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789478484.719440:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40ffb100 x1876403964453504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478484.719503:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964453504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789478485.118000:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478485.118045:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478485.118065:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945499136 00000100:00100000:0.0:1789478485.118074:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945499136 00000100:00100000:3.0:1789478485.118084:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478485.118116:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478485.118119:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 361 00000100:00100000:0.0:1789478485.118129:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10000850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2395:x1876403945499136:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478485.118134:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478485.118153:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478485.118186:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10000850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2395:x1876403945499136:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 59us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478485.118193:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 361 00000100:00100000:3.0:1789478485.118194:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945499520 00000100:00100000:3.0:1789478485.118197:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945499520 00000100:00100000:3.0:1789478485.118235:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 94 00000100:00100000:3.0:1789478485.118243:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945499520:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478485.118287:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945499520:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 45us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478485.118294:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 94 00000100:00100000:1.0:1789478485.118300:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945499264 00000100:00100000:1.0:1789478485.118309:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945499264 00000100:00100000:3.0:1789478485.118320:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945499392 00000100:00100000:3.0:1789478485.118323:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945499392 00000100:00100000:1.0:1789478485.118344:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945499648 00000100:00100000:1.0:1789478485.118347:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945499648 00000100:00100000:3.0:1789478485.121025:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945499776 00000100:00100000:3.0:1789478485.121038:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945499776 00000100:00100000:3.0:1789478485.121099:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 193 00000100:00100000:3.0:1789478485.121110:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945499264:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478485.121169:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945499264:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 61us (3123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478485.121176:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 193 00000100:00100000:3.0:1789478485.121191:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 194 00000100:00100000:3.0:1789478485.121197:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945499392:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478485.121222:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945499392:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 25us (3137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478485.121227:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 194 00000100:00100000:3.0:1789478485.121240:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 195 00000100:00100000:3.0:1789478485.121246:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2395:x1876403945499648:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478485.121266:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2395:x1876403945499648:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 20us (3130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478485.121271:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 195 00000100:00100000:3.0:1789478485.121281:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 196 00000100:00100000:3.0:1789478485.121286:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945499776:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478485.121318:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945499776:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 32us (3164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478485.121324:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 196 00000100:00080000:3.0:1789478485.121696:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789478485.121701:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789478485.121704:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789478485.220892:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789478485.220926:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964453632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789478485.221002:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478485.221176:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964453632 00000100:00100000:3.0:1789478485.221183:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964453632 00000100:00100000:3.0:1789478485.221248:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789478485.221258:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964453632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789478485.221277:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478485.221320:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964453632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478485.221327:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1789478485.221397:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789478485.221637:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03675880 x1876403964453632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478485.221656:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964453632:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789478485.540831:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789478486.373586:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789478486.375391:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789478486.566981:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478486.757071:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03675c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964453760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789478486.757133:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478486.757344:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789478486.757353:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964453888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789478486.757377:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478486.758312:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964453760 00000100:00100000:0.0:1789478486.758324:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964453760 00000100:00100000:0.0:1789478486.758380:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964453888 00000100:00100000:0.0:1789478486.758383:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964453888 00000100:00100000:0.0:1789478486.758402:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789478486.758412:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964453760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789478486.758444:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789478486.758629:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789478486.758639:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964453888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789478486.758659:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789478486.758707:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964453888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478486.758714:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789478486.758817:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964453760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 406us (1682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478486.758824:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789478486.758860:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964454016:0@lo:400:kworker.0 00000100:00100000:0.0:1789478486.758896:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478486.758947:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964453888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789478486.758993:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964454016 00000100:00100000:0.0:1789478486.758997:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964454016 00000100:00100000:0.0:1789478486.759024:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1789478486.759032:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3648:x1876403964454016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478486.759068:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3648:x1876403964454016:12345-0@lo:400:kworker.0 Request processed in 37us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478486.759086:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1789478486.759120:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964454016:0@lo:400:kworker.0 00000100:00100000:1.0:1789478486.760506:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03787800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964454144:0@lo:400:kworker.0 00000100:00100000:1.0:1789478486.760577:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478486.763194:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964454144 00000100:00100000:0.0:1789478486.763210:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964454144 00000100:00100000:0.0:1789478486.763284:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789478486.763294:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964454144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478486.763381:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964454144:12345-0@lo:400:kworker.0 Request processed in 89us (2803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478486.763388:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789478486.763569:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03787800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964454144:0@lo:400:kworker.0 00000100:00100000:3.0:1789478486.766043:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03785500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876403964454528:0@lo:400:kworker.0 00000100:00100000:3.0:1789478486.766105:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478486.766136:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876403964455040:0@lo:400:kworker.0 00000100:00100000:3.0:1789478486.766175:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478486.766200:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789478486.766219:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876403964454400:0@lo:400:kworker.0 00000100:00100000:3.0:1789478486.766244:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478486.766263:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876403964454912:0@lo:400:kworker.0 00000100:00100000:3.0:1789478486.766283:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478486.766322:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964454528 00000100:00100000:3.0:1789478486.766329:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964454528 00000100:00100000:3.0:1789478486.766373:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964455040 00000100:00100000:3.0:1789478486.766377:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964455040 00000100:00100000:3.0:1789478486.766393:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964454400 00000100:00100000:3.0:1789478486.766395:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964454400 00000100:00100000:3.0:1789478486.766407:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964454912 00000100:00100000:3.0:1789478486.766409:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964454912 00000100:00100000:3.0:1789478486.766422:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789478486.766429:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876403964454528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478486.766489:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876403964454528:12345-0@lo:400:kworker.0 Request processed in 60us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478486.766496:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789478486.766512:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789478486.766518:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876403964455040:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789478486.768004:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789478486.768011:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789478486.768030:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789478486.768045:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876403964454400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478486.768103:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876403964454400:12345-0@lo:400:kworker.0 Request processed in 66us (1858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478486.768110:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789478486.768128:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789478486.768134:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876403964454912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478486.768172:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876403964454912:12345-0@lo:400:kworker.0 Request processed in 38us (1888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478486.768177:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789478486.768230:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876403964454400:0@lo:400:kworker.0 00000100:00100000:0.0:1789478486.768240:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876403964454912:0@lo:400:kworker.0 00010000:00080000:0.0:1789478486.768252:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03785500 x1876403964454528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478486.768273:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03785500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876403964454528:0@lo:400:kworker.0 00000100:00100000:3.0:1789478486.768496:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876403964455040:12345-0@lo:400:kworker.0 Request processed in 1977us (2319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478486.768504:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789478486.768636:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03787800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964454656:0@lo:400:kworker.0 00000100:00100000:1.0:1789478486.768670:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478486.768698:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964455168:0@lo:400:kworker.0 00000100:00100000:1.0:1789478486.768716:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478486.768735:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789478486.768740:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964454272:0@lo:400:kworker.0 00000100:00100000:1.0:1789478486.768758:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478486.768771:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964454784:0@lo:400:kworker.0 00000100:00100000:1.0:1789478486.768786:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478486.768799:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964455296:0@lo:400:kworker.0 00000100:00100000:1.0:1789478486.768816:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478486.768839:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964454656 00000100:00100000:1.0:1789478486.768844:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964454656 00000100:00100000:1.0:1789478486.768867:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964455168 00000100:00100000:1.0:1789478486.768869:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964455168 00000100:00100000:1.0:1789478486.768883:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964454784 00000100:00100000:1.0:1789478486.768886:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964454784 00000100:00100000:1.0:1789478486.768895:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964455296 00000100:00100000:1.0:1789478486.768897:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964455296 00000100:00100000:1.0:1789478486.768907:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789478486.768913:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964454656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478486.768952:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964454656:12345-0@lo:400:kworker.0 Request processed in 39us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478486.768958:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789478486.768968:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789478486.768974:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964455168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478486.768993:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964455168:12345-0@lo:400:kworker.0 Request processed in 20us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478486.768998:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789478486.769006:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789478486.769011:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964454784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478486.769029:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964454784:12345-0@lo:400:kworker.0 Request processed in 19us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478486.769034:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789478486.769042:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789478486.769047:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964455296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478486.769064:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964455296:12345-0@lo:400:kworker.0 Request processed in 17us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478486.769068:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1789478486.769082:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789478486.769085:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789478486.769093:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964454272 00000100:00100000:1.0:1789478486.769096:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964454272 00000100:00100000:1.0:1789478486.769113:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789478486.769118:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964454272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478486.769139:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964454272:12345-0@lo:400:kworker.0 Request processed in 21us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478486.770437:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789478486.770515:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964454272:0@lo:400:kworker.0 00010000:00080000:1.0:1789478486.770620:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03784700 x1876403964454784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478486.770632:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964454784:0@lo:400:kworker.0 00000100:00100000:1.0:1789478486.770645:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964455296:0@lo:400:kworker.0 00010000:00080000:1.0:1789478486.770656:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03787800 x1876403964454656/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478486.770664:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03787800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964454656:0@lo:400:kworker.0 00000100:00100000:1.0:1789478486.770675:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964455168:0@lo:400:kworker.0 00010000:00080000:0.0:1789478486.771671:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb037e5500 x1876403964455040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478486.771686:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876403964455040:0@lo:400:kworker.0 00000100:00100000:2.0:1789478486.780316:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03675c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964453760:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789478487.274920:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789478487.274943:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03677100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964455424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789478487.275098:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478487.275156:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964455424 00000100:00100000:3.0:1789478487.275164:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964455424 00000100:00100000:3.0:1789478487.275205:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789478487.275228:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964455424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789478487.275260:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478487.275314:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964455424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478487.275321:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789478487.275865:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03677100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964455424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789478487.276570:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789478487.276583:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964455552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789478487.276659:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478487.276736:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964455552 00000100:00100000:0.0:1789478487.276743:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964455552 00000100:00100000:0.0:1789478487.276789:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789478487.276799:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964455552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789478487.276814:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478487.276863:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964455552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478487.276870:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789478487.276947:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964455552:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789478487.588793:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478488.615576:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478489.636769:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478489.829362:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964455680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789478489.829437:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478489.830261:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964455680 00000100:00100000:0.0:1789478489.830270:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964455680 00000100:00080000:1.0:1789478489.830334:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789478489.830335:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789478489.830348:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964455680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789478489.830375:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478489.830433:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964455680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478489.830440:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:2.0:1789478489.830706:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c1e300 x1876403964455680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478489.830727:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964455680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789478490.241762:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478490.241798:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478490.241829:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478490.241899:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945500160 00000100:00100000:1.0:1789478490.241907:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945500160 00000100:00100000:1.0:1789478490.241961:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945500032 00000100:00100000:1.0:1789478490.241963:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945500032 00000100:00100000:1.0:1789478490.241980:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 203 00000100:00100000:1.0:1789478490.241989:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945500160:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478490.242057:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945500160:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 69us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478490.242077:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 203 00000100:00100000:1.0:1789478490.242092:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 204 00000100:00100000:1.0:1789478490.242098:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945500032:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478490.242118:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945500032:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 21us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478490.242123:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 204 00000100:00080000:2.0:1789478490.242230:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789478490.242234:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789478490.243493:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945499904 00000100:00100000:0.0:1789478490.243502:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945499904 00000100:00100000:0.0:1789478490.243556:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 363 00000100:00100000:0.0:1789478490.243565:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2395:x1876403945499904:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478490.243669:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2395:x1876403945499904:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 106us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478490.243677:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 363 00000100:00100000:2.0:1789478490.251684:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478490.251776:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945500288 00000100:00100000:1.0:1789478490.251786:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945500288 00000100:00100000:1.0:1789478490.252070:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 27 00000100:00100000:1.0:1789478490.252082:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2394:x1876403945500288:12345-192.168.206.11@tcp:9:kworker.0 00000020:00000080:1.0:1789478490.252109:0:8430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215fc5 00000100:00080000:1.0:1789478490.252118:0:8430:0:(import.c:65:import_set_state_nolock()) ffff8ebb03681800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789478490.252158:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1789478490.252411:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789478490.252656:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478490.252726:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478490.253021:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478490.253213:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+2:2394:x1876403945500288:12345-192.168.206.11@tcp:9:kworker.0 Request processed in 1132us (1548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478490.253222:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 27 00000100:00100000:3.0:1789478490.253331:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945500416 00000100:00100000:3.0:1789478490.253338:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945500416 00000100:00100000:3.0:1789478490.253380:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945500544 00000100:00100000:3.0:1789478490.253383:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945500544 00000100:00100000:3.0:1789478490.253402:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 205 00000100:00100000:3.0:1789478490.253410:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945500416:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478490.253442:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945500416:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 34us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478490.253462:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 205 00000100:00100000:3.0:1789478490.253475:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 206 00000100:00080000:1.0:1789478490.254123:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789478490.254128:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789478490.254922:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945500544:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478490.255051:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945500544:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 1566us (2028us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478490.255060:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 206 00000100:00100000:2.0:1789478490.343840:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789478490.344533:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964455808:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789478490.344629:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478490.344818:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964455808 00000100:00100000:3.0:1789478490.344826:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964455808 00000100:00100000:3.0:1789478490.344894:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789478490.344904:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964455808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789478490.344924:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478490.344978:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964455808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478490.344997:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1789478490.345062:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789478490.345093:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03676d80 x1876403964455808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478506 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478490.345115:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964455808:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789478490.660720:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478491.685389:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478491.877383:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789478491.877413:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964455936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789478491.877489:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478491.877585:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964455936 00000100:00100000:3.0:1789478491.877611:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964455936 00000100:00100000:3.0:1789478491.877656:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789478491.877665:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964455936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789478491.877695:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789478491.877739:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964455936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478491.877747:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789478491.877790:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964455936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789478491.879101:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964456192:0@lo:400:kworker.0 00000100:00100000:0.0:1789478491.879148:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478491.879188:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964456704:0@lo:400:kworker.0 00000100:00100000:0.0:1789478491.879210:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478491.879228:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876403964457216:0@lo:400:kworker.0 00000100:00100000:0.0:1789478491.879248:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478491.879266:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789478491.879272:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964456320:0@lo:400:kworker.0 00000100:00100000:0.0:1789478491.879293:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478491.879306:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964456832:0@lo:400:kworker.0 00000100:00100000:0.0:1789478491.879326:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478491.879340:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964457344:0@lo:400:kworker.0 00000100:00100000:0.0:1789478491.879383:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478491.879411:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964456192 00000100:00100000:0.0:1789478491.879417:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964456192 00000100:00100000:0.0:1789478491.879464:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964456704 00000100:00100000:0.0:1789478491.879467:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964456704 00000100:00100000:0.0:1789478491.879489:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964457216 00000100:00100000:0.0:1789478491.879499:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964457216 00000100:00100000:0.0:1789478491.879521:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789478491.879529:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964456192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478491.879573:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964456192:12345-0@lo:400:kworker.0 Request processed in 44us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478491.879579:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789478491.879616:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789478491.879623:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964456704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478491.879650:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964456704:12345-0@lo:400:kworker.0 Request processed in 28us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478491.879656:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789478491.879669:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789478491.879675:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876403964457216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478491.879698:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876403964457216:12345-0@lo:400:kworker.0 Request processed in 24us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478491.879705:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789478491.879734:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964456192:0@lo:400:kworker.0 00010000:00080000:0.0:1789478491.879747:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c961c00 x1876403964456704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478491.879758:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964456704:0@lo:400:kworker.0 00010000:00080000:0.0:1789478491.879767:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c963800 x1876403964457216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478491.879775:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876403964457216:0@lo:400:kworker.0 00000100:00100000:1.0:1789478491.879991:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964456448:0@lo:400:kworker.0 00000100:00100000:1.0:1789478491.880019:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478491.880051:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964456960:0@lo:400:kworker.0 00000100:00100000:1.0:1789478491.880071:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478491.880095:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964457472:0@lo:400:kworker.0 00000100:00100000:1.0:1789478491.880126:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478491.880146:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1789478491.880152:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964456064:0@lo:400:kworker.0 00000100:00100000:1.0:1789478491.880177:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478491.880202:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964456576:0@lo:400:kworker.0 00000100:00100000:1.0:1789478491.880222:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478491.880239:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876403964457088:0@lo:400:kworker.0 00000100:00100000:1.0:1789478491.880258:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478491.880267:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964457600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478491.880284:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478491.880306:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964456448 00000100:00100000:1.0:1789478491.880309:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964456448 00000100:00100000:1.0:1789478491.880326:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964456576 00000100:00100000:1.0:1789478491.880328:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964456576 00000100:00100000:1.0:1789478491.880339:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964457088 00000100:00100000:1.0:1789478491.880340:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964457088 00000100:00100000:1.0:1789478491.880352:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789478491.880357:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964456448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478491.880390:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964456448:12345-0@lo:400:kworker.0 Request processed in 33us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478491.880396:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789478491.880408:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789478491.880414:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964456576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478491.880454:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964456576:12345-0@lo:400:kworker.0 Request processed in 41us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478491.880460:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789478491.880479:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789478491.880485:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876403964457088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478491.880513:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876403964457088:12345-0@lo:400:kworker.0 Request processed in 28us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478491.880518:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789478491.880536:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964456320 00000100:00100000:1.0:1789478491.880539:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964456320 00000100:00100000:1.0:1789478491.880557:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964457600 00000100:00100000:1.0:1789478491.880559:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964457600 00000100:00100000:1.0:1789478491.880570:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789478491.880576:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1876403964456320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478491.880642:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1876403964456320:12345-0@lo:400:kworker.0 Request processed in 66us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478491.880648:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789478491.880660:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789478491.880665:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964457600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789478491.880687:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789478491.880716:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964457600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478491.880721:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789478491.880736:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964456832 00000100:00100000:1.0:1789478491.880739:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964456832 00000100:00100000:1.0:1789478491.880753:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964457344 00000100:00100000:1.0:1789478491.880755:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964457344 00000100:00100000:1.0:1789478491.880766:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964456960 00000100:00100000:1.0:1789478491.880768:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964456960 00000100:00100000:1.0:1789478491.880778:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964457472 00000100:00100000:1.0:1789478491.880781:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964457472 00000100:00100000:1.0:1789478491.880805:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789478491.880811:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03675500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964456832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478491.880841:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03675500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964456832:12345-0@lo:400:kworker.0 Request processed in 31us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478491.880846:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789478491.880857:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789478491.880862:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03674380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964457344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478491.880887:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03674380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964457344:12345-0@lo:400:kworker.0 Request processed in 25us (1505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478491.880892:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789478491.880903:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789478491.880908:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964456960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478491.880933:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964456960:12345-0@lo:400:kworker.0 Request processed in 25us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478491.880938:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789478491.880950:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789478491.880956:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964457472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478491.880979:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964457472:12345-0@lo:400:kworker.0 Request processed in 24us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478491.880984:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1789478491.880999:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789478491.881003:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789478491.881005:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789478491.881007:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789478491.881016:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964456064 00000100:00100000:1.0:1789478491.881019:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964456064 00000100:00100000:1.0:1789478491.881066:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1789478491.881079:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964456064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478491.881108:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964456064:12345-0@lo:400:kworker.0 Request processed in 31us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478491.881114:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1789478491.881159:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964456064:0@lo:400:kworker.0 00000100:00100000:1.0:1789478491.881170:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964456576:0@lo:400:kworker.0 00000100:00100000:1.0:1789478491.881180:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876403964457088:0@lo:400:kworker.0 00000100:00100000:1.0:1789478491.881192:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964457600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478491.881202:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964456448:0@lo:400:kworker.0 00010000:00080000:1.0:1789478491.881212:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c962d80 x1876403964456960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478491.881221:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964456960:0@lo:400:kworker.0 00000100:00100000:1.0:1789478491.881230:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964457472:0@lo:400:kworker.0 00000100:00100000:1.0:1789478491.881269:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964456320:0@lo:400:kworker.0 00010000:00080000:1.0:1789478491.881279:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c963100 x1876403964456832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478491.881287:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964456832:0@lo:400:kworker.0 00000100:00100000:1.0:1789478491.881296:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964457344:0@lo:400:kworker.0 00000100:00100000:3.0:1789478492.389078:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03675c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964457856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789478492.389146:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478492.389191:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789478492.389199:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03677100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964457728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789478492.389222:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478492.389365:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964457856 00000100:00100000:2.0:1789478492.389374:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964457856 00000100:00100000:2.0:1789478492.389424:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964457728 00000100:00100000:2.0:1789478492.389428:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964457728 00000100:00100000:2.0:1789478492.389456:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789478492.389466:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964457856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789478492.389504:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789478492.389547:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964457856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478492.389554:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789478492.389569:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789478492.389576:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964457728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789478492.389585:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789478492.389627:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964457728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478492.389646:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789478492.390167:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03677100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964457728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789478492.390178:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03675c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964457856:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789478492.708767:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478493.732895:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478494.760687:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478494.956919:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964457984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789478494.956993:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478494.957129:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964457984 00000100:00100000:0.0:1789478494.957136:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964457984 00000100:00100000:0.0:1789478494.957191:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789478494.957201:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964457984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789478494.957228:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1789478494.957304:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789478494.960788:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964457984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3581us (3787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478494.961008:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:2.0:1789478494.961900:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c6ca80 x1876403964457984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478494.962135:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964457984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789478495.359630:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478495.359677:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478495.359684:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945500672 00000100:00100000:3.0:1789478495.359693:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945500672 00000100:00100000:2.0:1789478495.359709:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478495.359741:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 365 00000100:00100000:2.0:1789478495.359748:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478495.359753:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2396:x1876403945500672:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478495.359822:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2396:x1876403945500672:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 72us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478495.359828:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 365 00000100:00100000:2.0:1789478495.360046:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478495.360069:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945500928 00000100:00100000:0.0:1789478495.360075:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945500928 00000100:00100000:0.0:1789478495.360119:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945501184 00000100:00100000:0.0:1789478495.360122:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945501184 00000100:00100000:0.0:1789478495.360140:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945500800 00000100:00100000:0.0:1789478495.360142:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945500800 00000100:00100000:0.0:1789478495.360157:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 213 00000100:00100000:0.0:1789478495.360164:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945500928:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478495.360202:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945500928:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 38us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478495.360209:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 213 00000100:00100000:0.0:1789478495.360221:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 214 00000100:00100000:0.0:1789478495.360227:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945501184:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478495.360251:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945501184:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 23us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478495.360256:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 214 00000100:00100000:0.0:1789478495.360267:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 215 00000100:00100000:0.0:1789478495.360273:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945500800:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478495.360307:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945500800:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 34us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478495.360314:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 215 00000100:00080000:3.0:1789478495.360372:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789478495.360377:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789478495.360563:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945501056 00000100:00100000:1.0:1789478495.360569:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945501056 00000100:00100000:1.0:1789478495.360652:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 216 00000100:00100000:1.0:1789478495.360661:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945501056:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478495.360703:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2396:x1876403945501056:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 43us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478495.360710:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 216 00000100:00080000:1.0:1789478495.360732:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789478495.462011:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789478495.462042:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964458112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789478495.462105:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478495.462179:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964458112 00000100:00100000:1.0:1789478495.462185:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964458112 00000100:00100000:1.0:1789478495.462233:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789478495.462241:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964458112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789478495.462259:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789478495.462296:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964458112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478495.462303:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1789478495.462324:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789478495.462347:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c6ed80 x1876403964458112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478511 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478495.462365:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964458112:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789478495.781154:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789478495.978659:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 327dd6d5-45fd-4b52-99bf-74d27d1ede6e 00000020:00000080:0.0:1789478495.978667:0:9510:0:(genops.c:885:class_export_put()) final put ffff8ebb03685800/327dd6d5-45fd-4b52-99bf-74d27d1ede6e 00000020:00000080:2.0:1789478495.978742:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebb03685800/327dd6d5-45fd-4b52-99bf-74d27d1ede6e for lustre-OST0001 00000020:00000080:2.0:1789478495.978789:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebb03681800 for lustre-OST0001 00000040:00080000:2.0:1789478496.618316:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789478496.618981:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789478496.810205:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478496.996838:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964458240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789478496.996900:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478496.996964:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964458240 00000100:00100000:2.0:1789478496.996971:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964458240 00000100:00100000:2.0:1789478496.997013:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789478496.997022:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964458240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789478496.997053:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789478496.997307:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964458240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 286us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478496.997315:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789478496.997369:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964458240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789478496.998796:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964458368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789478496.998839:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478496.998886:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964458368 00000100:00100000:2.0:1789478496.998892:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964458368 00000100:00100000:2.0:1789478496.998925:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789478496.998933:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964458368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789478496.998958:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789478496.998998:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964458368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478496.999005:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789478496.999043:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964458368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789478496.999384:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964458496:0@lo:400:kworker.0 00000100:00100000:3.0:1789478496.999429:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478496.999452:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964459008:0@lo:400:kworker.0 00000100:00100000:3.0:1789478496.999477:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478496.999499:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964459520:0@lo:400:kworker.0 00000100:00100000:3.0:1789478496.999518:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478496.999535:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789478496.999541:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964458624:0@lo:400:kworker.0 00000100:00100000:3.0:1789478496.999559:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478496.999573:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964459136:0@lo:400:kworker.0 00000100:00100000:3.0:1789478496.999608:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478496.999624:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964459648:0@lo:400:kworker.0 00000100:00100000:3.0:1789478496.999642:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478496.999665:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964459008 00000100:00100000:3.0:1789478496.999668:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964459008 00000100:00100000:3.0:1789478496.999702:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964459520 00000100:00100000:3.0:1789478496.999705:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964459520 00000100:00100000:3.0:1789478496.999721:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964458624 00000100:00100000:3.0:1789478496.999732:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964458624 00000100:00100000:3.0:1789478496.999749:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789478496.999756:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964459008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478496.999793:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964459008:12345-0@lo:400:kworker.0 Request processed in 38us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478496.999800:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789478496.999812:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789478496.999817:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964459520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478496.999840:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964459520:12345-0@lo:400:kworker.0 Request processed in 24us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478496.999845:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789478496.999856:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789478496.999861:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964458624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478496.999887:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964458624:12345-0@lo:400:kworker.0 Request processed in 26us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478496.999893:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789478496.999909:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964458752:0@lo:400:kworker.0 00000100:00100000:3.0:1789478496.999932:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478496.999949:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964459264:0@lo:400:kworker.0 00000100:00100000:3.0:1789478496.999979:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478497.000061:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964458496 00000100:00100000:1.0:1789478497.000071:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964458496 00000100:00100000:1.0:1789478497.000100:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1789478497.000106:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964458496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478497.000136:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964458496:12345-0@lo:400:kworker.0 Request processed in 31us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478497.000148:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1789478497.000175:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964458752 00000100:00100000:1.0:1789478497.000178:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964458752 00000100:00100000:1.0:1789478497.000193:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789478497.000199:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964458752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478497.000226:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964458752:12345-0@lo:400:kworker.0 Request processed in 27us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478497.000231:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789478497.000425:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964459776:0@lo:400:kworker.0 00000100:00100000:3.0:1789478497.000448:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789478497.003673:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789478497.004408:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964459136 00000100:00100000:1.0:1789478497.004425:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964459136 00000100:00100000:3.0:1789478497.004440:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964458752:0@lo:400:kworker.0 00000100:00100000:3.0:1789478497.004460:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789478497.004469:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964458880:0@lo:400:kworker.0 00000100:00100000:1.0:1789478497.004474:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964459648 00000100:00100000:1.0:1789478497.004477:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964459648 00000100:00100000:1.0:1789478497.004488:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964459264 00000100:00100000:1.0:1789478497.004490:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964459264 00000100:00100000:1.0:1789478497.004501:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964459776 00000100:00100000:1.0:1789478497.004503:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964459776 00000100:00100000:1.0:1789478497.004516:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789478497.004523:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964459136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478497.004527:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478497.004546:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964459392:0@lo:400:kworker.0 00000100:00100000:3.0:1789478497.004565:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478497.004569:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964459136:12345-0@lo:400:kworker.0 Request processed in 46us (4977us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478497.004576:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789478497.004605:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789478497.004606:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964458880 00000100:00100000:3.0:1789478497.004609:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964458880 00000100:00100000:1.0:1789478497.004612:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c894380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964459648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478497.004633:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964459392 00000100:00100000:3.0:1789478497.004637:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964459392 00000100:00100000:1.0:1789478497.004639:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c894380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964459648:12345-0@lo:400:kworker.0 Request processed in 29us (4996us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478497.004645:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789478497.004650:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789478497.004655:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964458880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478497.004655:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789478497.004666:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c896300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964459264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478497.004687:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964458880:12345-0@lo:400:kworker.0 Request processed in 32us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478497.004688:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c896300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964459264:12345-0@lo:400:kworker.0 Request processed in 23us (4708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478497.004694:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789478497.004694:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789478497.004705:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789478497.004705:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789478497.004710:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964459392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478497.004711:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964459776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478497.004733:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964459776:12345-0@lo:400:kworker.0 Request processed in 23us (4284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478497.004734:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964459392:12345-0@lo:400:kworker.0 Request processed in 23us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478497.004740:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789478497.004740:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789478497.004767:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964458624:0@lo:400:kworker.0 00000100:00080000:1.0:1789478497.004773:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789478497.004776:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789478497.004778:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789478497.004780:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03634a80 x1876403964459136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478497.004790:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964459136:0@lo:400:kworker.0 00000100:00100000:3.0:1789478497.004801:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964459648:0@lo:400:kworker.0 00000100:00100000:3.0:1789478497.004811:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964458496:0@lo:400:kworker.0 00010000:00080000:3.0:1789478497.004821:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03634e00 x1876403964459008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478497.004836:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964459008:0@lo:400:kworker.0 00010000:00080000:3.0:1789478497.004851:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03635180 x1876403964459520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478497.004858:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964459520:0@lo:400:kworker.0 00000100:00100000:3.0:1789478497.004894:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964458880:0@lo:400:kworker.0 00000100:00100000:3.0:1789478497.004903:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964459392:0@lo:400:kworker.0 00010000:00080000:3.0:1789478497.004912:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03635880 x1876403964459264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478497.004920:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964459264:0@lo:400:kworker.0 00000100:00100000:3.0:1789478497.004929:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964459776:0@lo:400:kworker.0 00000100:00100000:3.0:1789478497.508731:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964459904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789478497.508798:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478497.508855:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964459904 00000100:00100000:3.0:1789478497.508863:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964459904 00000100:00100000:3.0:1789478497.508907:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789478497.508929:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964459904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789478497.509005:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478497.509079:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964459904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478497.509086:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789478497.509132:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964459904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789478497.510955:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964460032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789478497.511015:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478497.511077:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964460032 00000100:00100000:3.0:1789478497.511084:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964460032 00000100:00100000:3.0:1789478497.511123:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789478497.511132:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964460032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789478497.511173:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478497.511251:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964460032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478497.511259:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789478497.511301:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964460032:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789478497.828854:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478498.855018:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789478499.748872:0:14052:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 09:21:37 (1789478497) 00010000:00010000:3.0:1789478499.877975:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478500.068958:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964460160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789478500.069024:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478500.075032:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964460160 00000100:00100000:0.0:1789478500.075046:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964460160 00000100:00100000:0.0:1789478500.075181:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789478500.075202:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964460160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789478500.075233:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478500.075341:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964460160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (6307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478500.075349:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:2.0:1789478500.075510:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c963800 x1876403964460160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478516 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478500.075532:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964460160:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789478500.076486:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789478500.483319:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478500.483365:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478500.483407:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478500.483445:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478500.483861:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945501440 00000100:00100000:3.0:1789478500.483870:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945501440 00000100:00100000:3.0:1789478500.483932:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945501568 00000100:00100000:3.0:1789478500.483935:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945501568 00000100:00100000:3.0:1789478500.483947:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945501824 00000100:00100000:3.0:1789478500.483949:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945501824 00000100:00100000:3.0:1789478500.483964:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 223 00000100:00100000:3.0:1789478500.483972:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2398:x1876403945501440:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478500.484035:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2398:x1876403945501440:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 63us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478500.484059:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 223 00000100:00100000:3.0:1789478500.484075:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 224 00000100:00100000:3.0:1789478500.484082:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945501568:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478500.484108:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945501568:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 27us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478500.484114:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 224 00000100:00100000:3.0:1789478500.484126:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 225 00000100:00100000:3.0:1789478500.484132:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2397:x1876403945501824:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478500.484154:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2397:x1876403945501824:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 22us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478500.484159:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 225 00000100:00080000:2.0:1789478500.484419:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789478500.484423:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789478500.484639:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478500.487911:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945501312 00000100:00100000:1.0:1789478500.487924:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945501312 00000100:00100000:1.0:1789478500.487981:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 367 00000100:00100000:1.0:1789478500.487990:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2397:x1876403945501312:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478500.488054:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2397:x1876403945501312:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 66us (4689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478500.488062:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 367 00000100:00100000:2.0:1789478500.491355:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945501696 00000100:00100000:2.0:1789478500.491371:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945501696 00000100:00100000:2.0:1789478500.491453:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 226 00000100:00100000:2.0:1789478500.491479:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2398:x1876403945501696:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1789478500.491548:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2398:x1876403945501696:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 71us (6909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478500.491556:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 226 00000100:00080000:3.0:1789478500.491854:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789478500.581179:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789478500.581199:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964460288:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789478500.581271:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478500.581410:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964460288 00000100:00100000:2.0:1789478500.581417:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964460288 00000100:00100000:2.0:1789478500.581476:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789478500.581483:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03675880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964460288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789478500.581502:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789478500.581539:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03675880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964460288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478500.581545:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1789478500.581618:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789478500.581659:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03c6f800 x1876403964460288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478516 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478500.581675:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964460288:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789478500.902654:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478501.506325:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478501.506429:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945501952 00000100:00100000:0.0:1789478501.506438:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945501952 00000100:00100000:0.0:1789478501.506494:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 40 00000100:00100000:0.0:1789478501.506503:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:11056:x1876403945501952:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789478501.506535:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478501.506562:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e82160a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b72a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.506660:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82160ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.506674:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82160ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.506687:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82160ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789478501.506728:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789478501.506732:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789478501.506764:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82160ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.506786:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e82160a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72a0 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.506801:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82160ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72a0 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.506810:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc40e36900) 00010000:00010000:0.0:1789478501.506813:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789478501.506816:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b67c00, rc 0) 00000100:00100000:0.0:1789478501.506866:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:11056:x1876403945501952:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 364us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478501.506873:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 40 00000100:00100000:2.0:1789478501.524178:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478501.524274:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945502080 00000100:00100000:1.0:1789478501.524284:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945502080 00000100:00100000:1.0:1789478501.524340:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 41 00000100:00100000:1.0:1789478501.524350:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:11057:x1876403945502080:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789478501.524379:0:13638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478501.524408:0:13638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e82160b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b72a7 expref: -99 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524481:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82160ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524495:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82160ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524505:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82160ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524519:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82160c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524527:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82160c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524532:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82160c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524687:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e82160c8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524694:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e82160c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524701:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e82160c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478501.524736:0:13638:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789478501.524739:0:13638:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789478501.524758:0:13638:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e82160c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524778:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82160ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524784:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82160ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524791:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82160ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524796:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcf200 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478501.524800:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82160ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524808:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82160ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524820:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc40e36900) 00010000:00010000:1.0:1789478501.524823:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478501.524828:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82160ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524834:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82160ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524846:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82160c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524851:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82160c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524856:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82160c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524867:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcea00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478501.524870:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82160c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524876:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82160c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524885:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8ebc21ed2000) 00010000:00010000:1.0:1789478501.524887:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478501.524890:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82160c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524907:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82160c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524936:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e82160b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72a7 expref: 8 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524948:0:13638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e82160c8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72a7 expref: 7 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478501.524955:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ebc21ed2600) 00010000:00010000:1.0:1789478501.524957:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789478501.524959:0:13638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fce400, rc 0) 00000100:00100000:1.0:1789478501.525017:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:11057:x1876403945502080:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 668us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478501.525025:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 41 00000100:00100000:3.0:1789478501.529959:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478501.530135:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945502208 00000100:00100000:0.0:1789478501.530145:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945502208 00000100:00100000:0.0:1789478501.530201:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:0.0:1789478501.530212:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:11057:x1876403945502208:12345-192.168.206.11@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789478501.530700:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:11057:x1876403945502208:12345-192.168.206.11@tcp:900:lhsmtool_posix.0 Request processed in 488us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478501.530709:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:3.0:1789478501.537477:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478501.537572:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945502464 00000100:00100000:0.0:1789478501.537580:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945502464 00000100:00100000:0.0:1789478501.537664:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 42 00000100:00100000:0.0:1789478501.537674:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:11057:x1876403945502464:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789478501.537694:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478501.537714:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e82160cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b72ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.537776:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e82160d6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.537789:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e82160d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.537799:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e82160d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.537876:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82160dd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.537883:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82160dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.537919:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82160dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.538017:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66600/0x8ebaae74e82160e4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.538026:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66600/0x8ebaae74e82160e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.538032:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66600/0x8ebaae74e82160e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789478501.538040:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789478501.538247:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e82160d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.538254:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e82160d6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.538260:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e82160d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.538265:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67a00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478501.538269:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e82160d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.538275:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e82160d6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.538287:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ebc21ed2600) 00010000:00010000:0.0:1789478501.538289:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478501.538299:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e82160d6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.538304:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e82160d6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.538316:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82160dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.538321:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82160dd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.538325:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82160dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.538329:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478501.538332:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82160dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.538337:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82160dd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.538344:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ebc40e36800) 00010000:00010000:0.0:1789478501.538346:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478501.538348:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82160dd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.538353:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82160dd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.539998:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e82160cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72ae expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.540038:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66600/0x8ebaae74e82160e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72ae expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478501.540046:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ebc40e36e00) 00010000:00010000:0.0:1789478501.540049:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478501.540052:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b66600, rc 0) 00000100:00100000:0.0:1789478501.540120:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:11057:x1876403945502464:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 2447us (2650us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789478501.540129:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 42 00000100:00100000:1.0:1789478501.547189:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478501.551334:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945502592 00000100:00100000:2.0:1789478501.551348:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945502592 00000100:00100000:2.0:1789478501.551413:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 43 00000100:00100000:2.0:1789478501.551423:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:11057:x1876403945502592:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789478501.551522:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:11057:x1876403945502592:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 Request processed in 101us (4341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478501.551529:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 43 00000100:00100000:3.0:1789478501.554974:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478501.555510:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945502720 00000100:00100000:2.0:1789478501.555520:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945502720 00000100:00100000:2.0:1789478501.555587:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 44 00000100:00100000:2.0:1789478501.555627:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:11057:x1876403945502720:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1789478501.561117:0:10096:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 5450us 00000100:00100000:2.0:1789478501.596320:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:11057:x1876403945502720:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 Request processed in 40687us (41344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478501.596343:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 44 00000040:00080000:1.0:1789478501.733290:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789478501.736298:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789478501.930761:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478502.117757:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964460416:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789478502.117872:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478502.117944:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964460416 00000100:00100000:1.0:1789478502.117952:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964460416 00000100:00100000:1.0:1789478502.118006:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789478502.118019:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964460416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789478502.118049:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789478502.118093:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964460416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478502.118112:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789478502.118159:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964460416:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789478502.125512:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876403964460672:0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.125572:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478502.125627:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876403964461184:0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.125654:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478502.125670:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876403964461696:0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.125904:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478502.126017:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1789478502.126025:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964460544:0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.126052:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478502.126477:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876403964461056:0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.126502:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478502.126522:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876403964461568:0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.126539:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478502.126552:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964462080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789478502.126571:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478502.126635:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964460672 00000100:00100000:2.0:1789478502.126641:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964460672 00000100:00100000:2.0:1789478502.126671:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964461184 00000100:00100000:2.0:1789478502.126673:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964461184 00000100:00100000:2.0:1789478502.126691:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964461696 00000100:00100000:2.0:1789478502.126693:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964461696 00000100:00100000:2.0:1789478502.126703:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964461056 00000100:00100000:2.0:1789478502.126705:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964461056 00000100:00100000:2.0:1789478502.126714:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964461568 00000100:00100000:2.0:1789478502.126716:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964461568 00000100:00100000:2.0:1789478502.126814:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789478502.126822:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876403964460672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.126869:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876403964460672:12345-0@lo:400:kworker.0 Request processed in 48us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478502.126876:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789478502.126890:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789478502.126895:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876403964461184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.126917:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876403964461184:12345-0@lo:400:kworker.0 Request processed in 23us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478502.126923:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789478502.126932:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789478502.126937:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876403964461696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.126956:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876403964461696:12345-0@lo:400:kworker.0 Request processed in 20us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478502.126962:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789478502.126970:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789478502.126974:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876403964461056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.126992:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876403964461056:12345-0@lo:400:kworker.0 Request processed in 18us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478502.126998:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789478502.127006:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789478502.127011:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876403964461568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.127031:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876403964461568:12345-0@lo:400:kworker.0 Request processed in 20us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478502.127036:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789478502.127061:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964462080 00000100:00100000:2.0:1789478502.127064:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964462080 00000100:00100000:2.0:1789478502.127147:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789478502.127155:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964462080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789478502.127180:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789478502.127208:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964462080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478502.127214:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789478502.127340:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876403964461056:0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.127349:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876403964461568:0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.127492:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964462080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789478502.127507:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876403964460672:0@lo:400:kworker.0 00010000:00080000:2.0:1789478502.127518:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3cbc5500 x1876403964461184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478502.127529:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876403964461184:0@lo:400:kworker.0 00010000:00080000:2.0:1789478502.127537:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb037aca80 x1876403964461696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478502.127545:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876403964461696:0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.127585:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964460800:0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.127628:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478502.127645:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964461312:0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.127663:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478502.127678:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964461824:0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.127702:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478502.127719:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789478502.127931:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964460544 00000100:00100000:1.0:1789478502.127937:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964460544 00000100:00100000:1.0:1789478502.127966:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1789478502.127974:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3648:x1876403964460544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478502.128372:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3648:x1876403964460544:12345-0@lo:400:kworker.0 Request processed in 398us (2317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478502.128379:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1789478502.128417:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964461312 00000100:00100000:1.0:1789478502.128421:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964461312 00000100:00100000:1.0:1789478502.128442:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964461824 00000100:00100000:1.0:1789478502.128444:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964461824 00000100:00100000:1.0:1789478502.128460:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789478502.128465:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964461312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478502.128493:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964461312:12345-0@lo:400:kworker.0 Request processed in 28us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478502.128510:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789478502.128521:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789478502.128527:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964461824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478502.128555:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964461824:12345-0@lo:400:kworker.0 Request processed in 29us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478502.128561:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789478502.128585:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964460800 00000100:00100000:1.0:1789478502.128588:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964460800 00000100:00100000:1.0:1789478502.128630:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789478502.128637:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964460800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478502.128665:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964460800:12345-0@lo:400:kworker.0 Request processed in 29us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478502.128672:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789478502.128751:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964460544:0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.128864:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964460928:0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.128891:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478502.128917:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964461440:0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.128935:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478502.128953:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964461952:0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.128969:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478502.128986:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964460800:0@lo:400:kworker.0 00010000:00080000:2.0:1789478502.128997:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3cbc5180 x1876403964461312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478502.129006:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964461312:0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.129015:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964461824:0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.129036:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964461440 00000100:00100000:2.0:1789478502.129039:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964461440 00000100:00100000:2.0:1789478502.129058:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964461952 00000100:00100000:2.0:1789478502.129060:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964461952 00000100:00100000:2.0:1789478502.129072:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789478502.129088:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964461440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.129120:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964461440:12345-0@lo:400:kworker.0 Request processed in 43us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478502.129126:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789478502.129136:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789478502.129142:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964461952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.129172:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964461952:12345-0@lo:400:kworker.0 Request processed in 31us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478502.129179:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:2.0:1789478502.129202:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3cbc5f80 x1876403964461440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478502.129212:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964461440:0@lo:400:kworker.0 00000100:00100000:2.0:1789478502.129220:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964461952:0@lo:400:kworker.0 00000100:00100000:3.0:1789478502.129882:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964460928 00000100:00100000:3.0:1789478502.129888:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964460928 00000100:00100000:3.0:1789478502.129929:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789478502.129936:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964460928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478502.129993:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964460928:12345-0@lo:400:kworker.0 Request processed in 50us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478502.130000:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789478502.130418:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964460928:0@lo:400:kworker.0 00000100:00080000:1.0:1789478502.139913:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789478502.139923:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789478502.139925:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789478502.139928:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789478502.628785:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964462208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789478502.628849:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478502.628924:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964462208 00000100:00100000:3.0:1789478502.628930:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964462208 00000100:00100000:3.0:1789478502.628973:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789478502.628983:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964462208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789478502.629009:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478502.629064:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964462208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478502.629071:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789478502.629127:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964462208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789478502.629430:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789478502.629440:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03675c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964462336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789478502.629473:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478502.629667:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964462336 00000100:00100000:0.0:1789478502.629673:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964462336 00000100:00100000:0.0:1789478502.629697:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789478502.629705:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964462336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789478502.629716:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478502.629751:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964462336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478502.629756:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789478502.629797:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03675c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964462336:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789478502.948815:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478503.980293:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478504.040684:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478504.041018:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945502848 00000100:00100000:1.0:1789478504.041028:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945502848 00000100:00100000:1.0:1789478504.041105:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 45 00000100:00100000:1.0:1789478504.041116:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:11099:x1876403945502848:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1789478504.041133:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478504.041200:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e82160f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b72b5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.041259:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82160f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.041296:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82160f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.041307:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82160f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.041323:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216100 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.041331:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.041337:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.041385:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82160f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.041392:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82160f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.041399:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82160f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.041404:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfc00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478504.041408:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82160f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.041416:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82160f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.041426:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc40e36900) 00010000:00010000:1.0:1789478504.041435:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478504.041439:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82160f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.041446:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82160f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.041459:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.041466:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216100 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.041471:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216100 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.041476:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfe00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478504.041479:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216100 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.041484:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216100 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.041492:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ebb024ee200) 00010000:00010000:1.0:1789478504.041494:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478504.041497:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216100 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.041503:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216100 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.041533:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e82160f2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72b5 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.041554:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc40e36900) 00010000:00010000:1.0:1789478504.041556:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478504.041560:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e82160f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72b5 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.041570:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fce800, rc 0) 00000100:00100000:1.0:1789478504.041639:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:11099:x1876403945502848:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 526us (962us total) trans 0 rc 301/301 00000100:00100000:1.0:1789478504.041646:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 45 00000100:00080000:2.0:1789478504.041782:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789478504.044305:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478504.044336:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945503104 00000100:00100000:3.0:1789478504.044344:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945503104 00000100:00100000:3.0:1789478504.044400:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 46 00000100:00100000:3.0:1789478504.044410:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:11099:x1876403945503104:12345-192.168.206.11@tcp:36:lfs.0 00010000:00010000:3.0:1789478504.044455:0:10096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478504.044478:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82160ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72a0 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.044503:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc40e36900) 00010000:00010000:3.0:1789478504.044514:0:10096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789478504.044564:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216107 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.044588:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216107 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.044615:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216107 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.044629:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e821610e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.044636:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e821610e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.044644:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e821610e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.045064:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216115 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.045075:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216115 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.045082:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216115 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789478504.045095:0:10096:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5cb000b reply state 0000000047f0c8b5 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216115 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.045118:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216115 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.045124:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:3.0:1789478504.045127:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789478504.045130:0:10096:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789478504.045134:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789478504.045141:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216107 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.045149:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216107 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.045155:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216107 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.045161:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478504.045166:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216107 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.045173:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216107 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.045182:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebb02503800) 00010000:00010000:3.0:1789478504.045185:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478504.045188:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216107 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.045195:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216107 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789478504.045220:0:10096:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5cb000b reply state 0000000047f0c8b5 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e821610e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.045228:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e821610e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.045235:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ebb02503500) 00010000:00010000:3.0:1789478504.045237:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789478504.045239:0:10096:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789478504.045331:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+10:11099:x1876403945503104:12345-192.168.206.11@tcp:36:lfs.0 Request processed in 920us (1032us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789478504.045339:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 46 00000100:00100000:3.0:1789478504.123647:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478504.123724:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945503232 00000100:00100000:0.0:1789478504.123734:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945503232 00000100:00100000:0.0:1789478504.123792:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 47 00000100:00100000:0.0:1789478504.123803:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+10:11107:x1876403945503232:12345-192.168.206.11@tcp:101:lctl.0 00010000:00010000:0.0:1789478504.123825:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478504.123848:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e821611c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b72bc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.123923:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e8216123 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.123936:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e8216123 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.123946:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e8216123 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789478504.124054:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789478504.124059:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789478504.124093:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e8216123 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.124118:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e821611c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72bc expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.124134:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e8216123 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72bc expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.124143:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc40e80800) 00010000:00010000:0.0:1789478504.124146:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789478504.124149:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b67a00, rc 0) 00000100:00100000:0.0:1789478504.124198:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+11:11107:x1876403945503232:12345-192.168.206.11@tcp:101:lctl.0 Request processed in 396us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478504.124204:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 47 00000100:00100000:1.0:1789478504.199529:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478504.199621:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945503360 00000100:00100000:3.0:1789478504.199629:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945503360 00000100:00100000:3.0:1789478504.199682:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 48 00000100:00100000:3.0:1789478504.199691:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+11:11113:x1876403945503360:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:3.0:1789478504.199709:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478504.199728:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821612a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b72c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.199785:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216131 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.199799:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216131 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.199809:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216131 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.199832:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8216138 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.199840:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8216138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.199847:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8216138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.199925:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc200/0x8ebaae74e821613f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.199934:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc200/0x8ebaae74e821613f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.199941:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc200/0x8ebaae74e821613f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478504.199972:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789478504.199976:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789478504.200177:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc200/0x8ebaae74e821613f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.200188:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216131 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.200195:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216131 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.200202:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216131 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.200217:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478504.200221:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216131 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.200229:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216131 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.200241:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc40e80800) 00010000:00010000:3.0:1789478504.200244:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478504.200248:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216131 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.200253:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216131 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.200266:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8216138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.200273:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8216138 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.200278:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8216138 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.200283:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd000 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478504.200349:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8216138 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.200358:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8216138 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.200386:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ebb02503500) 00010000:00010000:3.0:1789478504.200389:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478504.200392:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8216138 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.200397:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8216138 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.200422:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821612a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72c3 expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.200434:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc200/0x8ebaae74e821613f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72c3 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.200440:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:3.0:1789478504.200443:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789478504.200445:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fc200, rc 0) 00000100:00100000:3.0:1789478504.200550:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+12:11113:x1876403945503360:12345-192.168.206.11@tcp:101:bash.0 Request processed in 859us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478504.200558:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 48 00000100:00100000:0.0:1789478504.209255:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478504.209401:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945503616 00000100:00100000:3.0:1789478504.209410:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945503616 00000100:00100000:3.0:1789478504.209496:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 49 00000100:00100000:3.0:1789478504.209507:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+12:11113:x1876403945503616:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:3.0:1789478504.209525:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478504.209543:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216146 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b72ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.209676:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821614d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.209690:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821614d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.209700:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821614d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.209771:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8216154 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.209779:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8216154 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.209786:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8216154 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789478504.210365:0:6518:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789478504.210504:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821615b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.210512:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821615b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.210520:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821615b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.210549:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821614d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.210566:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821614d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.210572:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821614d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.210578:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478504.210582:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821614d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.210589:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821614d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.210633:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:3.0:1789478504.210636:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478504.210641:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821614d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.210646:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821614d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789478504.210658:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5cdff9a reply state 0000000032c5c6a9 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8216154 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.210668:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8216154 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.210674:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ebb02503800) 00010000:00010000:3.0:1789478504.210676:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789478504.210679:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789478504.210706:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216146 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72ca expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.210727:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821615b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72ca expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.210734:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503900) 00010000:00010000:3.0:1789478504.210737:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789478504.210739:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fd800, rc 0) 00000100:00100000:3.0:1789478504.210788:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+15:11113:x1876403945503616:12345-192.168.206.11@tcp:101:bash.0 Request processed in 1283us (1541us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789478504.210797:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 49 00000100:00100000:1.0:1789478504.221918:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478504.222068:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945503744 00000100:00100000:2.0:1789478504.222077:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945503744 00000100:00100000:2.0:1789478504.222117:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 28 00000100:00100000:2.0:1789478504.222124:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2394:x1876403945503744:12345-192.168.206.11@tcp:8:bash.0 00010000:00080000:2.0:1789478504.222154:0:8431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp t0 exp 0000000000000000 cur 333 last 0 00000020:00000080:2.0:1789478504.222179:0:8431:0:(genops.c:1385:class_connect()) connect: client 327dd6d5-45fd-4b52-99bf-74d27d1ede6e, cookie 0x8ebaae74e8216169 00002000:00100000:2.0:1789478504.222192:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 327dd6d5-45fd-4b52-99bf-74d27d1ede6e/ffff8ebb03d76800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789478504.222207:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789478504.222265:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789478504.222487:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8ebb03d71000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789478504.222553:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2394:x1876403945503744:12345-192.168.206.11@tcp:8:bash.0 Request processed in 427us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478504.222571:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 28 00000100:00100000:1.0:1789478504.226481:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478504.226637:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945503872 00000100:00100000:2.0:1789478504.226645:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945503872 00000100:00100000:2.0:1789478504.227891:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 29 00000100:00100000:2.0:1789478504.227904:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:0:x1876403945503872:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:2.0:1789478504.227922:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478504.227944:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1daea95/0x8ebaae74e8216170 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b72d1 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789478504.227968:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789478504.227985:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=333s v=(0 0) 00010000:00010000:2.0:1789478504.227990:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478504.227999:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1daea95/0x8ebaae74e8216170 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d1 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478504.228018:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e1daea95/0x8ebaae74e8216170 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d1 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478504.228031:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76c00, rc 0) 00000100:00100000:2.0:1789478504.228091:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:0:x1876403945503872:12345-192.168.206.11@tcp:101:bash.0 Request processed in 191us (1618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478504.228097:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 29 00000100:00080000:1.0:1789478504.232276:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789478504.236408:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478504.236556:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945504000 00000100:00100000:2.0:1789478504.236568:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945504000 00000100:00100000:2.0:1789478504.236647:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 30 00000100:00100000:2.0:1789478504.236656:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03677100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:11113:x1876403945504000:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:2.0:1789478504.236677:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478504.236693:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dafac8af/0x8ebaae74e8216177 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b72d8 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478504.236721:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1daea95/0x8ebaae74e8216170 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d1 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478504.236730:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478504.236734:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478504.236740:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dafac8af/0x8ebaae74e8216177 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d8 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478504.236771:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e1daea95/0x8ebaae74e8216170 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d1 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478504.236784:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e1daea95/0x8ebaae74e8216170 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d1 expref: 8 pid: 8430 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478504.236797:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1876403964462464:192.168.206.11@tcp:104: 00000100:00100000:2.0:1789478504.236869:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc10043c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789478504.240527:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478504.240710:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945504128 00000100:00100000:3.0:1789478504.240718:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945504128 00010000:00010000:3.0:1789478504.240754:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e1daea95/0x8ebaae74e8216170 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d1 expref: 9 pid: 8430 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478504.240802:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:3.0:1789478504.240812:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08341850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:2396:x1876403945504128:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789478504.240826:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478504.240847:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e1daea95/0x8ebaae74e8216170 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d1 expref: 9 pid: 8430 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.240861:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e1daea95/0x8ebaae74e8216170 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d1 expref: 9 pid: 8430 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.240900:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478504.240914:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478504.240923:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dafac8af/0x8ebaae74e8216177 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d8 expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.240934:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dafac8af/0x8ebaae74e8216177 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d8 expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.240995:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dafac8af/0x8ebaae74e8216177 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d8 expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478504.241009:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6504:1876403964462592:192.168.206.11@tcp:105: 00000100:00100000:3.0:1789478504.241088:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc1a66a600 going to sleep for 11 seconds 00010000:00010000:2.0:1789478504.241831:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1daea95/0x8ebaae74e8216170 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d1 expref: 9 pid: 8430 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478504.241848:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1876403964462464:192.168.206.11@tcp:104: 00010000:00010000:2.0:1789478504.241871:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dafac8af/0x8ebaae74e8216177 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d8 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478504.241902:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76600, rc 0) 00000100:00100000:2.0:1789478504.241948:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03677100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:11113:x1876403945504000:12345-192.168.206.11@tcp:101:bash.0 Request processed in 5292us (5547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478504.241964:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 30 00000100:00100000:3.0:1789478504.257216:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6504:1876403964462592:192.168.206.11@tcp:105: 00010000:00010000:3.0:1789478504.257245:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478504.257300:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08341850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2396:x1876403945504128:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 16489us (16781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478504.257310:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:0.0:1789478504.257503:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478504.257633:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945504384 00000100:00100000:2.0:1789478504.257639:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945504384 00000100:00100000:2.0:1789478504.257686:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00100000:2.0:1789478504.257696:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+15:11113:x1876403945504384:12345-192.168.206.11@tcp:35:bash.0 00000100:00100000:2.0:1789478504.257944:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+16:11113:x1876403945504384:12345-192.168.206.11@tcp:35:bash.0 Request processed in 249us (441us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789478504.257952:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00100000:0.0:1789478504.364961:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478504.365027:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945504640 00000100:00100000:3.0:1789478504.365040:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945504640 00000100:00100000:3.0:1789478504.365184:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 50 00000100:00100000:3.0:1789478504.365196:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+16:11123:x1876403945504640:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1789478504.365217:0:13638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478504.365244:0:13638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e821617e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b72df expref: -99 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478504.365325:0:13638:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789478504.365533:0:13638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e821617e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72df expref: 18 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.365547:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc40e80800) 00010000:00010000:3.0:1789478504.365550:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789478504.365555:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e821617e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72df expref: 18 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.365567:0:13638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fd600, rc 0) 00000100:00100000:3.0:1789478504.365792:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+17:11123:x1876403945504640:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 596us (838us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1789478504.365799:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 50 00000100:00100000:0.0:1789478504.368541:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478504.368740:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945504896 00000100:00100000:2.0:1789478504.368749:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945504896 00000100:00100000:2.0:1789478504.368823:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:2.0:1789478504.368833:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+17:11123:x1876403945504896:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:2.0:1789478504.369069:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:11123:x1876403945504896:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 237us (534us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789478504.369077:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:1.0:1789478504.483122:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478504.483234:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945505024 00000100:00100000:3.0:1789478504.483243:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945505024 00000100:00100000:3.0:1789478504.483308:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:3.0:1789478504.483319:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:11129:x1876403945505024:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1789478504.483341:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478504.483359:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e821618c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b72e6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.483427:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216193 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.483440:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216193 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.483463:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216193 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478504.483518:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789478504.483522:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789478504.483538:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216193 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.483562:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e821618c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72e6 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.483578:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216193 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72e6 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.483587:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:3.0:1789478504.483590:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789478504.483638:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fd400, rc 0) 00000100:00100000:3.0:1789478504.483693:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+19:11129:x1876403945505024:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 375us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478504.483700:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:0.0:1789478504.498738:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478504.498827:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945505280 00000100:00100000:3.0:1789478504.498836:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945505280 00000100:00100000:3.0:1789478504.498901:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:3.0:1789478504.498911:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+19:11129:x1876403945505280:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1789478504.498928:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478504.498946:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e821619a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b72ed expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.499073:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82161a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.499107:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82161a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.499119:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82161a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478504.499131:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789478504.499231:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e821619a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72ed expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.499249:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82161a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72ed expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.499257:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503900) 00010000:00010000:3.0:1789478504.499260:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789478504.499264:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fce00, rc 0) 00000100:00100000:3.0:1789478504.499320:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+21:11129:x1876403945505280:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 410us (589us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789478504.499327:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:0.0:1789478504.519735:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478504.519779:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478504.519864:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945505536 00000100:00100000:3.0:1789478504.519872:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945505536 00000100:00100000:3.0:1789478504.519935:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 53 00000100:00100000:3.0:1789478504.519945:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+21:11129:x1876403945505536:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1789478504.519967:0:13638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478504.519995:0:13638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e82161af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b72f4 expref: -99 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.520106:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82161b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.520121:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82161b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.520131:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82161b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478504.520143:0:13638:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789478504.520232:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e82161af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72f4 expref: 24 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.520249:0:13638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82161b6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72f4 expref: 23 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.520258:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503900) 00010000:00010000:3.0:1789478504.520261:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789478504.520264:0:13638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fc000, rc 0) 00000100:00100000:3.0:1789478504.520322:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+23:11129:x1876403945505536:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 379us (595us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789478504.520329:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 53 00000100:00100000:1.0:1789478504.520748:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945505664 00000100:00100000:1.0:1789478504.520754:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945505664 00000100:00100000:1.0:1789478504.520792:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:1.0:1789478504.520800:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+23:2395:x1876403945505664:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789478504.520809:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478504.520823:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82161a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72ed expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.520835:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503900) 00010000:00010000:1.0:1789478504.520839:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478504.520862:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+22:2395:x1876403945505664:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 64us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478504.520885:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:1.0:1789478504.538049:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478504.538136:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945505792 00000100:00100000:2.0:1789478504.538144:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945505792 00000100:00100000:2.0:1789478504.538199:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 31 00000100:00100000:2.0:1789478504.538208:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2395:x1876403945505792:12345-192.168.206.11@tcp:1:lfs.0 00010000:00010000:2.0:1789478504.538248:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005218b69e/0x8ebaae74e82161c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478504.538278:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dafac8af/0x8ebaae74e8216177 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d8 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478504.538287:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478504.538291:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789478504.538295:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005218b69e/0x8ebaae74e82161c4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478504.538329:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dafac8af/0x8ebaae74e8216177 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d8 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478504.538343:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dafac8af/0x8ebaae74e8216177 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d8 expref: 7 pid: 8431 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478504.538357:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1876403964462720:192.168.206.11@tcp:104: 00000100:00100000:2.0:1789478504.538458:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc10043900 going to sleep for 11 seconds 00000100:00100000:1.0:1789478504.542203:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1876403964462720:192.168.206.11@tcp:104: 00010000:00010000:1.0:1789478504.542232:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005218b69e/0x8ebaae74e82161c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478504.545681:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478504.546182:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945505920 00000100:00100000:0.0:1789478504.546192:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945505920 00002000:00100000:0.0:1789478504.546234:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8ebb037ad180 x1876403945505920/t0(0) o4->327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp:165/0 lens 504/0 e 0 to 0 dl 1789478515 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789478504.546244:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ebb037ad180 with x1876403945505920 ext(0->12) 00010000:00010000:0.0:1789478504.546253:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000dafac8af/0x8ebaae74e8216177 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d8 expref: 8 pid: 8431 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.546269:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000dafac8af/0x8ebaae74e8216177 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d8 expref: 8 pid: 8431 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789478504.546277:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ebb037ad180 00000100:00100000:0.0:1789478504.546311:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:0.0:1789478504.546320:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2396:x1876403945505920:12345-192.168.206.11@tcp:4:lfs.0 00000001:00100000:2.0:1789478504.548102:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 327dd6d5-45fd-4b52-99bf-74d27d1ede6e 00000100:00100000:0.0:1789478504.549526:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:2396:x1876403945505920:12345-192.168.206.11@tcp:4:lfs.0 Request processed in 3199us (3846us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789478504.549539:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 0 00002000:00100000:0.0:1789478504.549550:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8ebb037ad180 x1876403945505920/t4294967300(0) o4->327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp:165/0 lens 504/448 e 0 to 0 dl 1789478515 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789478504.549576:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ebb037ad180 with x1876403945505920 ext(0->12) 00010000:00010000:0.0:1789478504.549585:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000dafac8af/0x8ebaae74e8216177 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d8 expref: 9 pid: 8431 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.549629:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000dafac8af/0x8ebaae74e8216177 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d8 expref: 9 pid: 8431 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789478504.549637:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ebb037ad180 00000100:00100000:2.0:1789478504.552452:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478504.552629:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945506048 00000100:00100000:0.0:1789478504.552638:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945506048 00010000:00010000:0.0:1789478504.552672:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dafac8af/0x8ebaae74e8216177 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d8 expref: 9 pid: 8431 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478504.552716:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 53 00000100:00100000:0.0:1789478504.552725:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:2395:x1876403945506048:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478504.552739:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789478504.552754:0:6502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789478504.552757:0:6502:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789478503 00002000:00010000:0.0:1789478504.552759:0:6502:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789478504 00002000:00010000:0.0:1789478504.552761:0:6502:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789478503 00002000:00010000:0.0:1789478504.552763:0:6502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789478504.552769:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dafac8af/0x8ebaae74e8216177 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d8 expref: 9 pid: 8431 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.552783:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dafac8af/0x8ebaae74e8216177 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d8 expref: 9 pid: 8431 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.552819:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dafac8af/0x8ebaae74e8216177 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72d8 expref: 9 pid: 8431 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.552836:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789478504.552840:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789478504.552846:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005218b69e/0x8ebaae74e82161c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.552856:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005218b69e/0x8ebaae74e82161c4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.552896:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478504.552945:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2395:x1876403945506048:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 221us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478504.552953:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 53 00010000:00010000:1.0:1789478504.553137:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005218b69e/0x8ebaae74e82161c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.553147:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005218b69e/0x8ebaae74e82161c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.553166:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005218b69e/0x8ebaae74e82161c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.553174:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005218b69e/0x8ebaae74e82161c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.553181:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005218b69e/0x8ebaae74e82161c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.553187:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77800 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:1.0:1789478504.553192:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005218b69e/0x8ebaae74e82161c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.553211:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005218b69e/0x8ebaae74e82161c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.553223:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005218b69e/0x8ebaae74e82161c4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.553230:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005218b69e/0x8ebaae74e82161c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478504.553288:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2395:x1876403945505792:12345-192.168.206.11@tcp:1:lfs.0 Request processed in 15080us (15248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478504.553296:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 31 00000100:00100000:2.0:1789478504.556420:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478504.556525:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945506304 00000100:00100000:3.0:1789478504.556534:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945506304 00000100:00100000:3.0:1789478504.556584:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 8 00000100:00100000:3.0:1789478504.556633:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+22:11129:x1876403945506304:12345-192.168.206.11@tcp:35:lfs.0 00000004:00010000:3.0:1789478504.556686:0:6520:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82161b6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72f4 expref: 22 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789478504.556951:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1789478504.557009:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1789478504.557266:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1789478504.557297:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e82161cb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.557310:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821615b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72ca expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.557319:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e82161cb lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.557347:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821615b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72ca expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.557360:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821615b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72ca expref: 26 pid: 6518 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478504.557388:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035a6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6520:1876403964462848:192.168.206.11@tcp:104: 00000100:00100000:3.0:1789478504.558079:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc1a66ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789478504.564930:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478504.566212:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035a6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6520:1876403964462848:192.168.206.11@tcp:104: 00010000:00010000:3.0:1789478504.566239:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e82161cb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478504.569731:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945506432 00000100:00100000:2.0:1789478504.569744:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945506432 00010000:00010000:2.0:1789478504.569789:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821615b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72ca expref: 27 pid: 6518 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478504.569887:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 54 00000100:00100000:2.0:1789478504.569910:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+27:2396:x1876403945506432:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789478504.569925:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478504.569932:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821615b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72ca expref: 27 pid: 6518 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478504.569945:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821615b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72ca expref: 27 pid: 6518 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478504.569966:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821615b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72ca expref: 27 pid: 6518 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478504.569993:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503900) 00010000:00010000:2.0:1789478504.569997:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e82161cb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478504.570006:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e82161cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478504.570014:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e82161cb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478504.570043:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478504.570091:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+26:2396:x1876403945506432:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 183us (5169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478504.570113:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 54 00010000:00010000:0.0:1789478504.570949:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e82161cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.570959:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e82161cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789478504.571060:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1789478504.571185:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1789478504.571266:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03784e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1876403964462976:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789478504.571315:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478504.571350:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc3c8a6840 going to sleep for 11 seconds 00000100:00100000:3.0:1789478504.572275:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964462976 00000100:00100000:3.0:1789478504.572283:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964462976 00000100:00100000:3.0:1789478504.572350:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789478504.572360:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6520:x1876403964462976:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789478504.572483:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6520:x1876403964462976:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 123us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478504.572490:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1789478504.572586:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789478504.572646:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03784e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1876403964462976:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789478504.572780:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1789478504.572826:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03784e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1876403964463104:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789478504.572860:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478504.572878:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc3c8a6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789478504.573544:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964463104 00000100:00100000:3.0:1789478504.573550:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964463104 00000100:00100000:3.0:1789478504.573590:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789478504.573621:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1876403964463104:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789478504.573737:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6520:x1876403964463104:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 117us (874us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789478504.573743:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789478504.573844:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03784e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1876403964463104:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789478504.573894:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1789478504.573923:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e82161cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.573932:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e82161cb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.573939:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e82161cb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.573945:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478504.573950:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e82161cb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.573957:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e82161cb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.573970:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503900) 00010000:00010000:0.0:1789478504.573985:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789478504.573990:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e82161cb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.573996:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e82161cb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789478504.574087:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789478504.574141:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1789478504.574152:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 333689557055ns, next at 334689554415ns, rc = 0 00000001:00080000:0.0:1789478504.574158:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1789478504.574178:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503900) 00010000:00010000:0.0:1789478504.574182:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789478504.574188:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82161b6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72f4 expref: 30 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478504.574263:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+29:11129:x1876403945506304:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 17671us (17864us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1789478504.574271:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 8 00000020:00080000:0.0:1789478504.574274:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789478504.577729:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478504.577801:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945506560 00000100:00100000:3.0:1789478504.577810:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945506560 00000100:00100000:3.0:1789478504.577863:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 54 00000100:00100000:3.0:1789478504.577873:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+29:11129:x1876403945506560:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1789478504.577904:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478504.577924:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82161d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b72fb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.578034:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82161d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72fb expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.578052:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82161d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72fb expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478504.578071:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:3.0:1789478504.578074:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789478504.578089:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fce00, rc 0) 00000100:00100000:3.0:1789478504.578134:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+30:11129:x1876403945506560:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 261us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478504.578141:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 54 00000100:00100000:3.0:1789478504.581263:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478504.581333:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945506816 00000100:00100000:2.0:1789478504.581341:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945506816 00000100:00100000:2.0:1789478504.581394:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:2.0:1789478504.581404:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc0838e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+30:11129:x1876403945506816:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:2.0:1789478504.581588:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc0838e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+31:11129:x1876403945506816:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 185us (329us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789478504.581621:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:3.0:1789478504.679283:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478504.679431:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945507072 00000100:00100000:2.0:1789478504.679440:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945507072 00000100:00100000:2.0:1789478504.679493:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 55 00000100:00100000:2.0:1789478504.679504:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+31:11139:x1876403945507072:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:2.0:1789478504.679526:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478504.679545:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e82161d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7302 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478504.679656:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789478504.679744:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e82161d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7302 expref: 33 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478504.679758:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc40e80800) 00010000:00010000:2.0:1789478504.679761:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789478504.679766:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e82161d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7302 expref: 33 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478504.679780:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76800, rc 0) 00000100:00100000:2.0:1789478504.679832:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+32:11139:x1876403945507072:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 330us (557us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1789478504.679839:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 55 00000100:00100000:1.0:1789478504.689411:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478504.689499:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945507200 00000100:00100000:0.0:1789478504.689507:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945507200 00000100:00100000:0.0:1789478504.689567:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 56 00000100:00100000:0.0:1789478504.689577:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+32:11139:x1876403945507200:12345-192.168.206.11@tcp:34:lfs.0 00010000:00010000:0.0:1789478504.689682:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e82161e7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.689698:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e82161e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.689711:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e82161e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.689722:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82161ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.689742:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82161ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.689749:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82161ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.689819:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82161f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.689827:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82161f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.689833:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82161f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789478504.689873:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82161f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.689899:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e82161e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.689906:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e82161e7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.689913:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e82161e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.689918:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67e00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478504.689922:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e82161e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.689929:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e82161e7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.689949:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:0.0:1789478504.689952:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478504.689956:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e82161e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.689962:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e82161e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.689974:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82161ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.689992:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82161ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.689999:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82161ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.690004:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478504.690007:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82161ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.690013:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82161ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.690019:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ebb02503800) 00010000:00010000:0.0:1789478504.690022:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478504.690025:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82161ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.690030:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82161ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.690051:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82161f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.690056:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82161f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.690062:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82161f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.690067:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67c00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478504.690070:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82161f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.690076:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82161f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.690083:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:0.0:1789478504.690085:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478504.690088:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82161f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.690094:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82161f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478504.690178:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+32:11139:x1876403945507200:12345-192.168.206.11@tcp:34:lfs.0 Request processed in 601us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478504.690185:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 56 00000100:00100000:1.0:1789478504.695544:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478504.695786:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945507456 00000100:00100000:2.0:1789478504.695795:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945507456 00000100:00100000:2.0:1789478504.695843:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:2.0:1789478504.695864:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+32:11139:x1876403945507456:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:2.0:1789478504.696130:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+33:11139:x1876403945507456:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 266us (593us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1789478504.696138:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:1.0:1789478504.762193:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478504.762286:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945507712 00000100:00100000:0.0:1789478504.762296:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945507712 00000100:00100000:0.0:1789478504.762350:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:0.0:1789478504.762383:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+33:11142:x1876403945507712:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1789478504.762413:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478504.762433:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82161fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7309 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.762504:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216203 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.762518:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216203 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.762528:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216203 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.762538:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821620a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.762544:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821620a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.762550:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821620a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.762689:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216211 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.762698:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216211 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.762706:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216211 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789478504.762726:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789478504.762792:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216203 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.762799:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216203 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.762807:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216203 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.762813:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478504.762816:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216203 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.762824:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216203 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.762836:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:0.0:1789478504.762839:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478504.762844:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216203 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.762850:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216203 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.762861:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821620a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.762867:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821620a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.762896:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821620a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.762901:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67e00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478504.762904:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821620a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.762910:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821620a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.762917:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ebb02503800) 00010000:00010000:0.0:1789478504.762920:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478504.762922:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821620a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.762928:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821620a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.762963:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82161fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7309 expref: 36 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.763093:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216211 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7309 expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478504.763102:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:0.0:1789478504.763104:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789478504.763107:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc42176000, rc 0) 00000100:00100000:0.0:1789478504.763165:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+35:11142:x1876403945507712:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 795us (980us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1789478504.763181:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:3.0:1789478504.765930:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478504.766272:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945507840 00000100:00100000:1.0:1789478504.766281:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945507840 00000100:00100000:1.0:1789478504.766335:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00100000:1.0:1789478504.766345:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+35:11142:x1876403945507840:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:1.0:1789478504.766414:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821621f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.766430:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821621f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.766441:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821621f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.766490:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821621f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.766498:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821621f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.766504:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821621f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.766510:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fce800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478504.766514:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821621f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.766522:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821621f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.766534:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:1.0:1789478504.766537:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789478504.766541:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821621f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478504.766546:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821621f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478504.766676:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+35:11142:x1876403945507840:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 331us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478504.766683:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00100000:1.0:1789478504.772301:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478504.772389:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945508096 00000100:00100000:0.0:1789478504.772398:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945508096 00000100:00100000:0.0:1789478504.772462:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 11 00000100:00100000:0.0:1789478504.772473:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+35:11142:x1876403945508096:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:0.0:1789478504.772708:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+36:11142:x1876403945508096:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 237us (415us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1789478504.772715:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 11 00010000:00010000:3.0:1789478504.997063:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478505.146291:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478505.151276:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945508352 00000100:00100000:1.0:1789478505.151290:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945508352 00000100:00100000:1.0:1789478505.152094:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 59 00000100:00100000:1.0:1789478505.152118:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+36:11173:x1876403945508352:12345-192.168.206.11@tcp:101:cat.0 00010000:00010000:1.0:1789478505.152141:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478505.152161:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e8216226 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7310 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.152251:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e821622d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.152265:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e821622d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.152276:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e821622d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478505.152287:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789478505.152419:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e8216226 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7310 expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.152437:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e821622d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7310 expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.152445:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:1.0:1789478505.152450:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789478505.152453:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcf200, rc 0) 00000100:00100000:1.0:1789478505.152522:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+38:11173:x1876403945508352:12345-192.168.206.11@tcp:101:cat.0 Request processed in 409us (6240us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1789478505.152530:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 59 00000100:00100000:3.0:1789478505.155849:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478505.155945:0:10392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945508480 00000100:00100000:0.0:1789478505.155954:0:10392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945508480 00000100:00100000:0.0:1789478505.156011:0:10392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:0.0:1789478505.156021:0:10392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+38:2396:x1876403945508480:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478505.156034:0:10392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478505.156058:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e821622d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7310 expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478505.156077:0:10392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:0.0:1789478505.156082:0:10392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478505.156147:0:10392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+37:2396:x1876403945508480:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 127us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478505.156155:0:10392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:0.0:1789478505.157574:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478505.161218:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945508736 00000100:00100000:2.0:1789478505.161233:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945508736 00000100:00100000:2.0:1789478505.161410:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:2.0:1789478505.161422:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+37:11173:x1876403945508736:12345-192.168.206.11@tcp:35:cat.0 00000100:00100000:2.0:1789478505.161696:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+38:11173:x1876403945508736:12345-192.168.206.11@tcp:35:cat.0 Request processed in 276us (4126us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1789478505.161705:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:0.0:1789478505.190411:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964463232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789478505.190480:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478505.190900:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964463232 00000100:00100000:2.0:1789478505.190909:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964463232 00000100:00100000:2.0:1789478505.190953:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789478505.190961:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876403964463232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789478505.190991:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789478505.191049:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876403964463232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478505.191056:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789478505.191194:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964463232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789478505.201679:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478505.202030:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945508992 00000100:00100000:2.0:1789478505.202040:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945508992 00000100:00100000:2.0:1789478505.202103:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 60 00000100:00100000:2.0:1789478505.202114:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+38:11179:x1876403945508992:12345-192.168.206.11@tcp:101:dd.0 00010000:00010000:2.0:1789478505.202137:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478505.202141:0:10096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789478505.202168:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216193 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72e6 expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.202200:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:2.0:1789478505.202205:0:10096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789478505.202218:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e821623b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7317 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.202311:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216242 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.202325:0:10096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216211 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7309 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.202332:0:10096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216242 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.202361:0:10096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216211 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7309 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.202384:0:10096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216211 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7309 expref: 38 pid: 6518 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478505.203214:0:10096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10096:1876403964463360:192.168.206.11@tcp:104: 00000100:00100000:2.0:1789478505.203291:0:10096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc10043900 going to sleep for 11 seconds 00000100:00100000:3.0:1789478505.206776:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478505.207049:0:10096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10096:1876403964463360:192.168.206.11@tcp:104: 00010000:00010000:2.0:1789478505.207074:0:10096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216242 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478505.207139:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945509120 00000100:00100000:0.0:1789478505.207158:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945509120 00010000:00010000:0.0:1789478505.207190:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216211 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7309 expref: 39 pid: 6518 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478505.207229:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 55 00000100:00100000:0.0:1789478505.207239:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+39:2396:x1876403945509120:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478505.207251:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478505.207258:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216211 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7309 expref: 39 pid: 6518 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478505.207269:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216211 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7309 expref: 39 pid: 6518 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478505.207289:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216211 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7309 expref: 39 pid: 6518 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478505.207305:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:0.0:1789478505.207310:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216242 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478505.207319:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216242 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478505.207326:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216242 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478505.207353:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478505.207432:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+38:2396:x1876403945509120:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 193us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478505.207451:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 55 00010000:00010000:2.0:1789478505.207721:0:10096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216242 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.207736:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216242 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478505.207756:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789478505.207891:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e821623b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7317 expref: 39 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.207908:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216242 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7317 expref: 38 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.207917:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:2.0:1789478505.207920:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789478505.207922:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76400, rc 0) 00000100:00100000:2.0:1789478505.207965:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+38:11179:x1876403945508992:12345-192.168.206.11@tcp:101:dd.0 Request processed in 5853us (6295us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789478505.207973:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 60 00000100:00100000:3.0:1789478505.210823:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478505.211421:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945509248 00000100:00100000:0.0:1789478505.211431:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945509248 00000100:00100000:0.0:1789478505.211489:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 61 00000100:00100000:0.0:1789478505.211500:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+38:11179:x1876403945509248:12345-192.168.206.11@tcp:101:dd.0 00010000:00010000:0.0:1789478505.211522:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478505.211540:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216250 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b731e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478505.211571:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216257 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478505.211584:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216257 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478505.211633:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216257 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478505.211740:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216250 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b731e expref: 40 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478505.211759:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216257 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b731e expref: 39 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478505.211768:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:0.0:1789478505.211771:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789478505.211774:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc42177000, rc 0) 00000100:00100000:0.0:1789478505.211827:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+39:11179:x1876403945509248:12345-192.168.206.11@tcp:101:dd.0 Request processed in 329us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478505.211843:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 61 00000100:00100000:0.0:1789478505.220671:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478505.220772:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945509504 00000100:00100000:1.0:1789478505.220781:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945509504 00000100:00100000:1.0:1789478505.220841:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 62 00000100:00100000:1.0:1789478505.220850:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+39:11179:x1876403945509504:12345-192.168.206.11@tcp:36:dd.0 00010000:00010000:1.0:1789478505.221061:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821625e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.221079:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821625e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.221089:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821625e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789478505.221130:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:1.0:1789478505.221152:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000817e73da reply state 00000000d7381506 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821625e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.221164:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821625e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.221171:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:1.0:1789478505.221174:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789478505.221177:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789478505.221259:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+42:11179:x1876403945509504:12345-192.168.206.11@tcp:36:dd.0 Request processed in 409us (594us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1789478505.221266:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 62 00000020:00080000:1.0:1789478505.221270:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789478505.436855:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478505.437328:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945509632 00000100:00100000:2.0:1789478505.437336:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945509632 00000100:00100000:2.0:1789478505.437423:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 63 00000100:00100000:2.0:1789478505.437432:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+42:11193:x1876403945509632:12345-192.168.206.11@tcp:101:stat.0 00010000:00010000:2.0:1789478505.437691:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478505.437823:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216265 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7325 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.437884:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e821626c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.437914:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e821626c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.437925:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e821626c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.437936:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216273 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.437943:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216273 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.437949:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216273 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.438020:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e821627a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.438031:0:10096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216242 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7317 expref: 43 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.438039:0:10096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e821627a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.438070:0:10096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216242 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7317 expref: 43 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.438083:0:10096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216242 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7317 expref: 43 pid: 10096 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478505.438107:0:10096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10096:1876403964463488:192.168.206.11@tcp:104: 00000100:00100000:2.0:1789478505.438233:0:10096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc10043900 going to sleep for 11 seconds 00000100:00100000:3.0:1789478505.453893:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478505.453961:0:10096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10096:1876403964463488:192.168.206.11@tcp:104: 00010000:00010000:2.0:1789478505.454106:0:10096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e821627a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478505.454174:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945509888 00000100:00100000:0.0:1789478505.454181:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945509888 00000100:00100000:0.0:1789478505.454233:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 13 00000100:00100000:0.0:1789478505.454243:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+44:6162:x1876403945509888:12345-192.168.206.11@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789478505.454534:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+45:6162:x1876403945509888:12345-192.168.206.11@tcp:35:ldlm_bl.0 Request processed in 292us (647us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1789478505.454545:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 13 00000100:00100000:0.0:1789478505.457068:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478505.459661:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945510016 00000100:00100000:2.0:1789478505.459675:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945510016 00010000:00010000:2.0:1789478505.459723:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216242 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7317 expref: 45 pid: 10096 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478505.459815:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 56 00000100:00100000:2.0:1789478505.459825:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03598700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+45:2396:x1876403945510016:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789478505.459838:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478505.459846:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216242 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7317 expref: 45 pid: 10096 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.459858:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216242 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7317 expref: 45 pid: 10096 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.459889:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216242 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7317 expref: 45 pid: 10096 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.459907:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:2.0:1789478505.459912:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e821627a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.459934:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e821627a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.459940:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e821627a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.459980:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478505.460040:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03598700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+44:2396:x1876403945510016:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 217us (2978us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478505.460047:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 56 00010000:00010000:3.0:1789478505.460767:0:10096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e821627a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.460776:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e821627a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478505.460827:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789478505.460831:0:10096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789478505.460883:0:10096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e821627a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.460897:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e821627a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.460906:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e821626c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.460926:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e821626c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.460933:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e821626c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.460939:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77e00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478505.460942:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e821626c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.460950:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e821626c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.460961:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:3.0:1789478505.460964:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478505.460977:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e821626c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.460983:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e821626c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.460995:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216273 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.461002:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216273 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.461008:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216273 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.461012:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76e00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478505.461021:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216273 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.461027:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216273 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.461034:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ebb02503800) 00010000:00010000:3.0:1789478505.461037:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478505.461040:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216273 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.461045:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216273 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.461074:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216265 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7325 expref: 44 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.461088:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e821627a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7325 expref: 43 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.461095:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:3.0:1789478505.461097:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789478505.461099:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76000, rc 0) 00000100:00100000:3.0:1789478505.461132:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+43:11193:x1876403945509632:12345-192.168.206.11@tcp:101:stat.0 Request processed in 23701us (24286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478505.461139:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 63 00000100:00100000:3.0:1789478505.525288:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478505.525397:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945510272 00000100:00100000:0.0:1789478505.525406:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945510272 00000100:00100000:0.0:1789478505.525462:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 64 00000100:00100000:0.0:1789478505.525472:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+43:11199:x1876403945510272:12345-192.168.206.11@tcp:36:truncate.0 00010000:00010000:0.0:1789478505.525523:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478505.525559:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e821627a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7325 expref: 43 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478505.525577:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:0.0:1789478505.525582:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789478505.525773:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216281 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478505.525787:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216281 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478505.525796:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216281 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789478505.525849:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1789478505.525870:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cf5e3d9 reply state 00000000125939b0 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216281 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478505.525880:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216281 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478505.525886:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:0.0:1789478505.525889:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789478505.525891:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789478505.526005:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+45:11199:x1876403945510272:12345-192.168.206.11@tcp:36:truncate.0 Request processed in 525us (716us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1789478505.526013:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 64 00000020:00080000:0.0:1789478505.526018:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789478505.599253:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478505.599309:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478505.599377:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478505.599406:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478505.599436:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478505.599462:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945510912 00000100:00100000:1.0:1789478505.599471:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945510912 00000100:00100000:1.0:1789478505.599524:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945510528 00000100:00100000:1.0:1789478505.599527:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945510528 00000100:00100000:1.0:1789478505.599548:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945510784 00000100:00100000:1.0:1789478505.599551:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945510784 00000100:00100000:1.0:1789478505.599568:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 233 00000100:00100000:1.0:1789478505.599576:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2395:x1876403945510912:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478505.599673:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2395:x1876403945510912:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 96us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478505.599680:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 233 00000100:00100000:1.0:1789478505.599703:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 234 00000100:00100000:1.0:1789478505.599711:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945510528:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478505.599736:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945510528:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 26us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478505.599742:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 234 00000100:00100000:1.0:1789478505.599753:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 235 00000100:00100000:1.0:1789478505.599759:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2395:x1876403945510784:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478505.599782:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2395:x1876403945510784:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 23us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478505.599787:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 235 00000100:00080000:1.0:1789478505.599801:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789478505.599806:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789478505.600364:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945510400 00000100:00100000:3.0:1789478505.600382:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945510400 00000100:00100000:3.0:1789478505.600423:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 369 00000100:00100000:3.0:1789478505.600439:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2395:x1876403945510400:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1789478505.600560:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945510656 00000100:00100000:2.0:1789478505.600564:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945510656 00000100:00100000:2.0:1789478505.600625:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 111 00000100:00100000:2.0:1789478505.600633:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2395:x1876403945510656:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478505.600962:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2395:x1876403945510400:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 523us (1716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478505.600970:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 369 00000100:00100000:2.0:1789478505.603095:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2395:x1876403945510656:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 2448us (3770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478505.603108:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 111 00000100:00100000:1.0:1789478505.638729:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478505.638976:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945511040 00000100:00100000:3.0:1789478505.638986:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945511040 00000100:00100000:3.0:1789478505.639048:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 65 00000100:00100000:3.0:1789478505.639059:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+45:11213:x1876403945511040:12345-192.168.206.11@tcp:101:stat.0 00010000:00010000:3.0:1789478505.639093:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478505.639114:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e8216288 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b732c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639172:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821628f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639185:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821628f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639195:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821628f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639206:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216296 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639214:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639220:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639299:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e821629d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639308:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e821629d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639315:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e821629d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478505.639351:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1789478505.639355:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789478505.639438:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e821629d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639450:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e821629d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639459:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821628f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639466:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821628f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639473:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821628f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639478:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478505.639482:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821628f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639490:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821628f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639509:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:3.0:1789478505.639512:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478505.639516:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821628f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639522:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821628f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639536:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639543:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216296 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639548:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216296 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639553:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fc000 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478505.639556:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216296 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639561:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216296 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639568:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ebb02503800) 00010000:00010000:3.0:1789478505.639570:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478505.639573:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216296 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639579:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216296 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639691:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e8216288 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b732c expref: 47 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639700:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e821629d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b732c expref: 46 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.639705:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:3.0:1789478505.639706:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789478505.639708:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fd600, rc 0) 00000100:00100000:3.0:1789478505.639756:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+46:11213:x1876403945511040:12345-192.168.206.11@tcp:101:stat.0 Request processed in 699us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478505.639763:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 65 00000100:00100000:2.0:1789478505.700971:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964463616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789478505.701054:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478505.701210:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964463616 00000100:00100000:0.0:1789478505.701219:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964463616 00000100:00100000:0.0:1789478505.701342:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789478505.701359:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964463616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789478505.701396:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478505.701464:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964463616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478505.701472:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789478505.701532:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964463616:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789478505.701765:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789478505.721712:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478505.721815:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945511296 00000100:00100000:2.0:1789478505.721824:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945511296 00000100:00100000:2.0:1789478505.721889:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 66 00000100:00100000:2.0:1789478505.721900:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+46:11223:x1876403945511296:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:2.0:1789478505.721919:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478505.721938:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82162a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7333 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478505.722157:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789478505.722247:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82162a4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7333 expref: 48 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.722261:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc40e80800) 00010000:00010000:2.0:1789478505.722264:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789478505.722269:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82162a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7333 expref: 48 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.722282:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76000, rc 0) 00000100:00100000:2.0:1789478505.722337:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+47:11223:x1876403945511296:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 439us (633us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1789478505.722345:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 66 00000100:00100000:2.0:1789478505.725776:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478505.725856:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945511552 00000100:00100000:0.0:1789478505.725865:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945511552 00000100:00100000:0.0:1789478505.725924:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00100000:0.0:1789478505.725935:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+47:11223:x1876403945511552:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:0.0:1789478505.726414:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+48:11223:x1876403945511552:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 479us (644us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1789478505.726423:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00100000:1.0:1789478505.777445:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478505.777530:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945511808 00000100:00100000:3.0:1789478505.777538:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945511808 00000100:00100000:3.0:1789478505.777619:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 67 00000100:00100000:3.0:1789478505.777631:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+48:11229:x1876403945511808:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:3.0:1789478505.777653:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478505.777673:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e82162b2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b733a expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.777771:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82162b9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.777784:0:10096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e821629d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b732c expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.777794:0:10096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82162b9 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.777836:0:10096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e821629d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b732c expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.777849:0:10096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e821629d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b732c expref: 49 pid: 6518 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478505.777862:0:10096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c94ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10096:1876403964463744:192.168.206.11@tcp:104: 00000100:00100000:3.0:1789478505.777950:0:10096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc1a66a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789478505.782435:0:10096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c94ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10096:1876403964463744:192.168.206.11@tcp:104: 00010000:00010000:3.0:1789478505.782462:0:10096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82162b9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478505.783773:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478505.784166:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945511936 00000100:00100000:3.0:1789478505.784174:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945511936 00010000:00010000:3.0:1789478505.784433:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e821629d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b732c expref: 50 pid: 6518 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478505.784514:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:3.0:1789478505.784524:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08341c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+50:2396:x1876403945511936:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789478505.784536:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478505.784543:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e821629d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b732c expref: 50 pid: 6518 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.784555:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e821629d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b732c expref: 50 pid: 6518 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.784625:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e821629d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b732c expref: 50 pid: 6518 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.784640:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:3.0:1789478505.784645:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82162b9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.784654:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82162b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.784661:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82162b9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.784679:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478505.784729:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08341c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+49:2396:x1876403945511936:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 207us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478505.784736:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 57 00010000:00010000:1.0:1789478505.784965:0:10096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82162b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.784980:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82162b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478505.784997:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1789478505.785115:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e82162b2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b733a expref: 50 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.785130:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82162b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b733a expref: 49 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.785137:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:1.0:1789478505.785140:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789478505.785142:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fc000, rc 0) 00000100:00100000:1.0:1789478505.785167:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+49:11229:x1876403945511808:12345-192.168.206.11@tcp:101:bash.0 Request processed in 7540us (7732us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1789478505.785174:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 67 00000100:00100000:1.0:1789478505.787691:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478505.787938:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945512192 00000100:00100000:3.0:1789478505.787948:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945512192 00000100:00100000:3.0:1789478505.788117:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 68 00000100:00100000:3.0:1789478505.788128:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+49:11229:x1876403945512192:12345-192.168.206.11@tcp:36:bash.0 00010000:00010000:3.0:1789478505.788332:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e82162c7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.788348:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e82162c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.788359:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e82162c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789478505.788423:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1789478505.788445:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000981c7c96 reply state 00000000ae1a70f9 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e82162c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.788457:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e82162c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.788464:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:3.0:1789478505.788467:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789478505.788471:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789478505.788549:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+52:11229:x1876403945512192:12345-192.168.206.11@tcp:36:bash.0 Request processed in 423us (865us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1789478505.788556:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 68 00000020:00080000:3.0:1789478505.788560:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789478505.793798:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478505.793880:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945512320 00000100:00100000:1.0:1789478505.793889:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945512320 00000100:00100000:1.0:1789478505.793946:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 69 00000100:00100000:1.0:1789478505.793957:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+52:11229:x1876403945512320:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:1.0:1789478505.793989:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478505.794019:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e82162ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7341 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.794137:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82162d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.794152:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82162b9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b733a expref: 53 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.794161:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82162d5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.794193:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82162b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b733a expref: 53 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.794206:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82162b9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b733a expref: 53 pid: 10096 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478505.794219:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964463872:192.168.206.11@tcp:104: 00000100:00100000:1.0:1789478505.794295:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc01254b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789478505.797004:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964463872:192.168.206.11@tcp:104: 00010000:00010000:0.0:1789478505.797031:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82162d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478505.797262:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478505.797462:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945512448 00000100:00100000:3.0:1789478505.797469:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945512448 00010000:00010000:3.0:1789478505.797501:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82162b9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b733a expref: 54 pid: 10096 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478505.797537:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00100000:3.0:1789478505.797547:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+54:2396:x1876403945512448:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789478505.797559:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478505.797566:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82162b9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b733a expref: 54 pid: 10096 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.797577:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82162b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b733a expref: 54 pid: 10096 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.797642:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82162b9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b733a expref: 54 pid: 10096 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.797658:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:3.0:1789478505.797663:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82162d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.797672:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82162d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.797679:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82162d5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478505.797701:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478505.797746:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+53:2396:x1876403945512448:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 200us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478505.797754:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 58 00010000:00010000:1.0:1789478505.798514:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82162d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.798525:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82162d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478505.798571:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789478505.798576:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789478505.798612:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82162d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.798652:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e82162ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7341 expref: 53 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.798668:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82162d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7341 expref: 52 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.798675:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:1.0:1789478505.798678:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789478505.798681:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcea00, rc 0) 00000100:00100000:1.0:1789478505.798853:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+52:11229:x1876403945512320:12345-192.168.206.11@tcp:101:bash.0 Request processed in 4897us (5062us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478505.798861:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 69 00000100:00100000:1.0:1789478505.801457:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478505.801553:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945512704 00000100:00100000:2.0:1789478505.801561:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945512704 00000100:00100000:2.0:1789478505.801769:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00100000:2.0:1789478505.801780:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc0838d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+52:11229:x1876403945512704:12345-192.168.206.11@tcp:35:bash.0 00000100:00100000:2.0:1789478505.802012:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc0838d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+53:11229:x1876403945512704:12345-192.168.206.11@tcp:35:bash.0 Request processed in 233us (561us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789478505.802020:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00100000:0.0:1789478505.880673:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478505.880758:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945512960 00000100:00100000:1.0:1789478505.880767:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945512960 00000100:00100000:1.0:1789478505.880831:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 70 00000100:00100000:1.0:1789478505.880842:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+53:11239:x1876403945512960:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1789478505.880865:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478505.880896:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e82162dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7348 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478505.880997:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789478505.881089:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e82162dc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7348 expref: 55 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.881104:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc40e80800) 00010000:00010000:1.0:1789478505.881118:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789478505.881124:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e82162dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7348 expref: 55 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.881138:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fce600, rc 0) 00000100:00100000:1.0:1789478505.881195:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+54:11239:x1876403945512960:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 355us (532us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1789478505.881202:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 70 00000100:00100000:3.0:1789478505.883245:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478505.883461:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945513088 00000100:00100000:1.0:1789478505.883469:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945513088 00000100:00100000:1.0:1789478505.883576:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 71 00000100:00100000:1.0:1789478505.883588:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+54:11239:x1876403945513088:12345-192.168.206.11@tcp:34:lfs.0 00010000:00010000:1.0:1789478505.883790:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82162ea lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.883804:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82162ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.883815:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82162ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.883825:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82162f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.883832:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82162f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.883838:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82162f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.884031:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82162f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.884052:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82162f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.884059:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82162f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789478505.884160:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82162f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.884172:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82162ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.884179:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82162ea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.884186:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82162ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.884191:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfc00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478505.884195:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82162ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.884202:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82162ea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.884212:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:1.0:1789478505.884215:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478505.884218:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82162ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.884224:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82162ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.884243:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82162f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.884250:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82162f1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.884256:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82162f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.884260:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcf200 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478505.884263:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82162f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.884269:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82162f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.884276:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ebb02503800) 00010000:00010000:1.0:1789478505.884278:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478505.884281:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82162f1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.884286:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82162f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.884293:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82162f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.884299:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82162f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.884305:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82162f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.884316:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfe00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478505.884319:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82162f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.884325:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82162f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.884331:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:1.0:1789478505.884333:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478505.884335:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82162f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.884341:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82162f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478505.884449:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+54:11239:x1876403945513088:12345-192.168.206.11@tcp:34:lfs.0 Request processed in 863us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478505.884458:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 71 00000100:00100000:2.0:1789478505.886542:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478505.886632:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945513344 00000100:00100000:0.0:1789478505.886640:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945513344 00000100:00100000:0.0:1789478505.886686:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:0.0:1789478505.886696:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+54:11239:x1876403945513344:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:0.0:1789478505.886916:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+55:11239:x1876403945513344:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 220us (378us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1789478505.886923:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:0.0:1789478505.912121:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478505.912211:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945513600 00000100:00100000:1.0:1789478505.912220:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945513600 00000100:00100000:1.0:1789478505.912274:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 72 00000100:00100000:1.0:1789478505.912283:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+55:11242:x1876403945513600:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1789478505.912305:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478505.912323:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82162ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b734f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912407:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8216306 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912439:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8216306 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912452:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8216306 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912464:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821630d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912472:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821630d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912478:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821630d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912586:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216314 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912632:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216314 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912640:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216314 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478505.912649:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789478505.912713:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8216306 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912721:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8216306 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912728:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8216306 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912739:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcf200 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478505.912744:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8216306 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912751:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8216306 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912763:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:1.0:1789478505.912766:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478505.912769:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8216306 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912776:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8216306 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912788:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821630d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912794:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821630d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912801:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821630d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912806:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfc00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478505.912808:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821630d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912814:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821630d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912829:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ebb02503800) 00010000:00010000:1.0:1789478505.912832:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478505.912835:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821630d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912840:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821630d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912874:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82162ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b734f expref: 58 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912887:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216314 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b734f expref: 57 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.912894:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:1.0:1789478505.912897:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789478505.912899:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fce600, rc 0) 00000100:00100000:1.0:1789478505.912948:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+57:11242:x1876403945513600:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 666us (835us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1789478505.912954:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 72 00000100:00100000:3.0:1789478505.916423:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478505.916456:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478505.916541:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945513856 00000100:00100000:2.0:1789478505.916549:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945513856 00000100:00100000:1.0:1789478505.916694:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945513728 00000100:00100000:1.0:1789478505.916699:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945513728 00000100:00100000:1.0:1789478505.916730:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 73 00000100:00100000:2.0:1789478505.916736:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:1.0:1789478505.916742:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+58:11242:x1876403945513728:12345-192.168.206.11@tcp:54:lfs.0 00000100:00100000:2.0:1789478505.916750:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+58:2395:x1876403945513856:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789478505.916774:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478505.916795:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216314 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b734f expref: 58 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.916797:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e8216322 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.916819:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e8216322 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.916951:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e8216322 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478505.917327:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:2.0:1789478505.917332:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478505.917428:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+57:2395:x1876403945513856:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 681us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478505.917436:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 5 00010000:00010000:1.0:1789478505.919064:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e8216322 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.919077:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e8216322 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.919084:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e8216322 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.919091:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcf600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478505.919095:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e8216322 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.919103:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e8216322 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.919116:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:1.0:1789478505.919119:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789478505.919123:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e8216322 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478505.919130:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e8216322 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478505.919200:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+56:11242:x1876403945513728:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 2458us (2782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478505.919209:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 73 00000100:00100000:3.0:1789478505.926427:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478505.926512:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945514112 00000100:00100000:2.0:1789478505.926520:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945514112 00000100:00100000:0.0:1789478505.926622:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:0.0:1789478505.926636:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+56:11242:x1876403945514112:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:0.0:1789478505.926853:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+57:11242:x1876403945514112:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 219us (433us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789478505.926863:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 17 00010000:00010000:3.0:1789478506.029168:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478506.039746:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478506.039840:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945514368 00000100:00100000:1.0:1789478506.039849:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945514368 00000100:00100000:1.0:1789478506.039954:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 74 00000100:00100000:1.0:1789478506.039963:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+57:11260:x1876403945514368:12345-192.168.206.11@tcp:101:cat.0 00010000:00010000:1.0:1789478506.039992:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478506.040011:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e8216329 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7356 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.040104:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216330 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.040119:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216330 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.040130:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216330 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478506.040140:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789478506.040226:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e8216329 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7356 expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.040243:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216330 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7356 expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.040252:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:1.0:1789478506.040255:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789478506.040258:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcfe00, rc 0) 00000100:00100000:1.0:1789478506.040311:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+59:11260:x1876403945514368:12345-192.168.206.11@tcp:101:cat.0 Request processed in 348us (572us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1789478506.040331:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 74 00000100:00080000:0.0:1789478506.040950:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789478506.056310:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478506.056414:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945514496 00000100:00100000:2.0:1789478506.056423:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945514496 00000100:00100000:2.0:1789478506.056481:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 75 00000100:00100000:2.0:1789478506.056492:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+59:11261:x1876403945514496:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:2.0:1789478506.056516:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478506.056534:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e821633e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b735d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.056587:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216345 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.056638:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216345 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.056648:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216345 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478506.056686:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789478506.056700:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789478506.056718:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216345 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.056742:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e821633e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b735d expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.056758:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216345 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b735d expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.056767:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:2.0:1789478506.056770:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789478506.056773:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76c00, rc 0) 00000100:00100000:2.0:1789478506.056816:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+60:11261:x1876403945514496:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 327us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478506.056823:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 75 00000100:00100000:3.0:1789478506.061488:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478506.061577:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945514880 00000100:00100000:0.0:1789478506.061632:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945514880 00000100:00100000:0.0:1789478506.061677:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:0.0:1789478506.061686:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+60:11261:x1876403945514880:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:0.0:1789478506.062007:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+61:11261:x1876403945514880:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 321us (525us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1789478506.062015:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:0.0:1789478506.064196:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478506.064273:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945515008 00000100:00100000:3.0:1789478506.064280:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945515008 00000100:00100000:3.0:1789478506.064374:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00100000:3.0:1789478506.064384:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+61:11261:x1876403945515008:12345-192.168.206.11@tcp:103:lfs.0 00010000:00010000:3.0:1789478506.064407:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789478506.064429:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82162d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7341 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.064448:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216330 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7356 expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.064459:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82161d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72fb expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.064469:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:3.0:1789478506.064473:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478506.064515:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+58:11261:x1876403945515008:12345-192.168.206.11@tcp:103:lfs.0 Request processed in 134us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478506.064522:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00100000:0.0:1789478506.066415:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478506.066506:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945515136 00000100:00100000:1.0:1789478506.066519:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945515136 00000100:00100000:1.0:1789478506.066627:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 76 00000100:00100000:1.0:1789478506.066636:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+58:11261:x1876403945515136:12345-192.168.206.11@tcp:58:lfs.0 00010000:00010000:1.0:1789478506.066741:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e821634c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.066756:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e821634c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.066767:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e821634c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789478506.066980:0:10096:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789478506.067108:0:10096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789478506.067201:0:10096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789478506.067258:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+58:11261:x1876403945515136:12345-192.168.206.11@tcp:58:lfs.0 Request processed in 622us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478506.067266:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 76 00000100:00100000:0.0:1789478506.093800:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478506.093896:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945515264 00000100:00100000:2.0:1789478506.093905:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945515264 00000100:00100000:2.0:1789478506.093958:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 77 00000100:00100000:2.0:1789478506.093979:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+58:11263:x1876403945515264:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:2.0:1789478506.093997:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478506.094015:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216353 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7364 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094088:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e821635a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094101:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e821635a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094121:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e821635a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094132:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216361 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094140:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216361 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094146:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216361 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094202:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216368 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094210:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216368 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094217:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216368 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478506.094251:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789478506.094255:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789478506.094270:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216368 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094435:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216368 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094444:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e821635a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094460:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e821635a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094467:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e821635a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094473:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478506.094477:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e821635a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094485:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e821635a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094497:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:2.0:1789478506.094500:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478506.094504:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e821635a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094510:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e821635a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094523:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216361 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094529:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216361 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094535:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216361 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094540:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478506.094547:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216361 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094554:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216361 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094560:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ebb02503800) 00010000:00010000:2.0:1789478506.094563:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478506.094566:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216361 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094572:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216361 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094768:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216353 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7364 expref: 60 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094784:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216368 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7364 expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.094791:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:2.0:1789478506.094794:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789478506.094796:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f77e00, rc 0) 00000100:00100000:2.0:1789478506.094852:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+59:11263:x1876403945515264:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 885us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478506.094859:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 77 00000001:00080000:3.0:1789478506.732894:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:3.0:1789478506.732939:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1789478506.732955:0:6496:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ebc3c8a6840 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789478506.732959:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ebb03625100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ebc3c8a6e40 00000020:00080000:3.0:1789478506.732963:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ebb03625000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ebb0350c400 00010000:00010000:0.0:1789478506.733045:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e821610e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733056:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e821610e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733064:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e821610e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733070:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fdc00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478506.733075:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e821610e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733082:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e821610e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733097:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ebb02503500) 00010000:00010000:0.0:1789478506.733100:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478506.733104:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e821610e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733124:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e821610e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733141:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216115 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733147:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216115 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733153:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216115 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733158:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fca00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478506.733161:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216115 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733167:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216115 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733173:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:0.0:1789478506.733176:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478506.733178:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216115 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733184:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216115 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733196:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8216154 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733202:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8216154 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733211:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8216154 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733216:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd000 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478506.733219:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8216154 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733225:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8216154 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733232:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ebb02503800) 00010000:00010000:0.0:1789478506.733234:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478506.733236:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8216154 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733241:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e8216154 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733253:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821625e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733259:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821625e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733264:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821625e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733269:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fce800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478506.733272:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821625e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733285:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821625e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733293:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:0.0:1789478506.733295:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478506.733298:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821625e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733303:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821625e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733313:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216281 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733319:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216281 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733325:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216281 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733329:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc42176000 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478506.733332:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216281 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733338:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216281 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733344:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:0.0:1789478506.733346:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478506.733348:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216281 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733375:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216281 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733389:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e82162c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733395:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e82162c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733400:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e82162c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733405:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478506.733409:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e82162c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733415:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e82162c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733424:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:0.0:1789478506.733426:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478506.733428:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e82162c7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478506.733435:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e82162c7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789478506.733574:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1789478506.733752:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1789478506.733923:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789478506.733943:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964464000:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789478506.734003:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478506.734536:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964464000 00000100:00100000:2.0:1789478506.734544:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964464000 00000100:00100000:2.0:1789478506.734635:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789478506.734646:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1876403964464000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789478506.734682:0:8829:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1789478506.734710:0:8829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aa94667, atime: 0x6aa94668, ctime: 0x6aa94667, blocks: 0x8 00010000:00010000:2.0:1789478506.734717:0:8829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e821636f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.734732:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=335s v=(0 0) 00010000:00010000:2.0:1789478506.734736:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478506.734742:0:8829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e821636f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.734757:0:8829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e821636f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.734765:0:8829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e821636f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.734773:0:8829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e821636f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.734788:0:8829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789478506.734911:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3647:x1876403964464000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 268us (907us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789478506.734918:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1789478506.735104:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789478506.735110:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e821636f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.735117:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76e00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478506.735121:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e821636f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.735137:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e821636f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.735150:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e821636f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.735156:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e821636f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.735174:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478506.735176:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478506.735177:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789478506.735226:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789478506.735258:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ebc3cbc5180/2, rc 0, transno 4294967302 00000100:00100000:0.0:1789478506.735264:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964464000:0@lo:6:osp-syn-0-0.0 00000040:00080000:1.0:1789478506.853251:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789478506.853259:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789478506.853294:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789478506.853302:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789478506.853435:0:13792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb036d5880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876403964464128:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789478506.853510:0:13792:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb034bfd80 going to sleep for 11 seconds 00000040:00080000:2.0:1789478506.865195:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789478506.869701:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478506.869729:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945515392 00000100:00100000:0.0:1789478506.869736:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945515392 00000100:00100000:0.0:1789478506.869780:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 78 00000100:00100000:0.0:1789478506.869790:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+13:11275:x1876403945515392:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789478506.869818:0:13638:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789478506.869926:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+13:11275:x1876403945515392:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 137us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478506.869933:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 78 00000100:00100000:3.0:1789478506.870768:0:13792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb036d5880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876403964464128:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789478506.882904:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478506.885685:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945515520 00000100:00100000:3.0:1789478506.885699:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945515520 00000100:00100000:3.0:1789478506.885767:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 79 00000100:00100000:3.0:1789478506.885777:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb034f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+12:11275:x1876403945515520:12345-192.168.206.11@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789478506.885838:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216376 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.885854:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216376 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.885878:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216376 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.885941:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821637d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.885960:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821637d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.885968:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821637d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.885996:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216384 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.886004:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.886162:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478506.886209:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789478506.886213:0:10096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789478506.886228:0:10096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.886239:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216376 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.886246:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216376 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.886252:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216376 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.886259:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fce00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478506.886263:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216376 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.886278:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216376 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.886290:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ebc40e36e00) 00010000:00010000:3.0:1789478506.886292:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478506.886297:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216376 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.886303:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216376 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.886316:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821637d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.886323:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821637d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.886328:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821637d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.886334:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478506.886337:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821637d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.886343:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821637d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.886350:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8ebb02275500) 00010000:00010000:3.0:1789478506.886353:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478506.886355:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821637d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.886380:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821637d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.886395:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.886400:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216384 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.886406:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216384 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.886410:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fc000 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478506.886413:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216384 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.886418:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216384 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.886426:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:3.0:1789478506.886428:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478506.886431:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216384 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.886436:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216384 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478506.886523:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb034f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+12:11275:x1876403945515520:12345-192.168.206.11@tcp:34:lhsmtool_posix.0 Request processed in 747us (3626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478506.886531:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 79 00000100:00100000:0.0:1789478506.890807:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478506.891007:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945515776 00000100:00100000:2.0:1789478506.891030:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945515776 00000100:00100000:2.0:1789478506.891085:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 80 00000100:00100000:2.0:1789478506.891094:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb034fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+12:11275:x1876403945515776:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789478506.891112:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478506.891130:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e821638b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b736b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.891220:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216392 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.891233:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216392 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.891244:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216392 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478506.891254:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789478506.891322:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216392 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.891330:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216392 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.891337:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216392 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.891343:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478506.891347:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216392 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.891373:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216392 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.891393:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:2.0:1789478506.891395:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789478506.891400:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216392 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.891405:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216392 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.891443:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e821638b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b736b expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.891453:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ebc40e36e00) 00010000:00010000:2.0:1789478506.891456:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789478506.891459:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e821638b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b736b expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478506.891468:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76000, rc 0) 00000100:00100000:2.0:1789478506.891540:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb034fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+13:11275:x1876403945515776:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 446us (742us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1789478506.891548:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 80 00000100:00100000:0.0:1789478506.897691:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478506.897811:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945515904 00000100:00100000:1.0:1789478506.897820:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945515904 00000100:00100000:1.0:1789478506.897883:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 81 00000100:00100000:1.0:1789478506.897893:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb034fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+13:11275:x1876403945515904:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789478506.897924:0:6518:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789478506.898057:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb034fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+13:11275:x1876403945515904:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 165us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478506.898065:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 81 00000100:00100000:0.0:1789478506.917516:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478506.917580:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945516160 00000100:00100000:1.0:1789478506.917625:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945516160 00000100:00100000:1.0:1789478506.917695:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 82 00000100:00100000:1.0:1789478506.917713:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb034fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+13:11275:x1876403945516160:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789478506.917738:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478506.917742:0:10096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789478506.917768:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216345 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b735d expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.917786:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:1.0:1789478506.917791:0:10096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789478506.917803:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e82163a0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7372 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789478506.918143:0:10096:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1789478506.918272:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82163a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.918284:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82163a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.918294:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82163a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.918353:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e82163a0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7372 expref: 15 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.918378:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82163a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7372 expref: 14 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.918386:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ebb024ee200) 00010000:00010000:1.0:1789478506.918389:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789478506.918392:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcea00, rc 0) 00000100:00100000:1.0:1789478506.918449:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb034fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+14:11275:x1876403945516160:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 738us (939us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789478506.918456:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 82 00000100:00100000:0.0:1789478506.923218:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478506.923289:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945516416 00000100:00100000:3.0:1789478506.923298:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945516416 00000100:00100000:3.0:1789478506.923355:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 83 00000100:00100000:3.0:1789478506.923375:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb034f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+14:11275:x1876403945516416:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789478506.923421:0:13638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478506.923444:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82163a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7372 expref: 14 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.923459:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ebb024ee200) 00010000:00010000:3.0:1789478506.923468:0:13638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789478506.923741:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82163b5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.923761:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82163b5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.923772:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82163b5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.923837:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e82163bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xcac09f45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.923845:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e82163bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xcac09f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.923853:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e82163bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xcac09f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.924781:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82163b5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.924803:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82163b5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.924810:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82163b5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.924816:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fc000 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478506.924820:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82163b5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.924828:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82163b5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.924838:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:3.0:1789478506.924841:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478506.924846:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82163b5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.924851:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e82163b5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.924861:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e82163bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xcac09f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.924879:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e82163bc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xcac09f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.924885:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e82163bc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xcac09f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.924890:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478506.924899:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e82163bc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xcac09f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.924905:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e82163bc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xcac09f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.924913:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xcac09f45 (ffff8ebb02275500) 00010000:00010000:3.0:1789478506.924916:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478506.924918:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e82163bc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xcac09f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478506.924923:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e82163bc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xcac09f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478506.925008:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb034f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+13:11275:x1876403945516416:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 1642us (1794us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789478506.927870:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 83 00000100:00100000:1.0:1789478506.935527:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478506.938564:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945516544 00000100:00100000:0.0:1789478506.938577:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945516544 00000100:00100000:1.0:1789478506.938833:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 84 00000100:00100000:1.0:1789478506.938844:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+13:11275:x1876403945516544:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789478506.938860:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478506.938890:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e82163c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7379 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.938922:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82163ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.938934:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82163ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.938944:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82163ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.939163:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e82163c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7379 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.939179:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82163ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7379 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.939187:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ebb024eed00) 00010000:00010000:1.0:1789478506.939190:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789478506.939193:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcfc00, rc 0) 00000100:00100000:1.0:1789478506.939255:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+14:11275:x1876403945516544:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 414us (3737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478506.939262:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 84 00000100:00100000:0.0:1789478506.941136:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478506.944991:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945516800 00000100:00100000:1.0:1789478506.945003:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945516800 00000100:00100000:1.0:1789478506.945083:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 85 00000100:00100000:1.0:1789478506.945094:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb034fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+14:11275:x1876403945516800:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789478506.945165:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82163d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.945180:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82163d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.945190:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82163d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789478506.945325:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1789478506.945335:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 336060740261ns, next at 337060737888ns, rc = 0 00000004:00010000:1.0:1789478506.945400:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000335b961a reply state 00000000004f0b6d transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82163d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.945412:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82163d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.945420:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ebb024eed00) 00010000:00010000:1.0:1789478506.945423:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789478506.945426:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789478506.945515:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb034fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+16:11275:x1876403945516800:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 422us (4384us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789478506.945523:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 85 00000100:00100000:0.0:1789478506.948127:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478506.948772:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945516928 00000100:00100000:1.0:1789478506.948781:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945516928 00000100:00100000:1.0:1789478506.948828:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 86 00000100:00100000:1.0:1789478506.948837:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+16:11275:x1876403945516928:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789478506.948856:0:13638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478506.948874:0:13638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82163d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7380 expref: -99 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.948923:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82163d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7380 expref: 17 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.948937:0:13638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82163d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7380 expref: 17 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478506.948953:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ebb024eed00) 00010000:00010000:1.0:1789478506.948956:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789478506.948965:0:13638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcf200, rc 0) 00000100:00100000:1.0:1789478506.952069:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+17:11275:x1876403945516928:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 177us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478506.952080:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 86 00000100:00100000:1.0:1789478506.953890:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478506.954147:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945517056 00000100:00100000:3.0:1789478506.954156:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945517056 00000100:00100000:3.0:1789478506.954201:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 33 00000100:00100000:3.0:1789478506.954209:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2394:x1876403945517056:12345-192.168.206.11@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789478506.954240:0:8431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp t0 exp 0000000000000000 cur 336 last 0 00000020:00000080:3.0:1789478506.954268:0:8431:0:(genops.c:1385:class_connect()) connect: client 327dd6d5-45fd-4b52-99bf-74d27d1ede6e, cookie 0x8ebaae74e82163df 00002000:00100000:3.0:1789478506.954280:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 327dd6d5-45fd-4b52-99bf-74d27d1ede6e/ffff8ebc056d8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789478506.954297:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789478506.954377:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789478506.954406:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8ebc056db800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789478506.954465:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2394:x1876403945517056:12345-192.168.206.11@tcp:8:lhsmtool_posix.0 Request processed in 255us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478506.954481:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 33 00000100:00100000:3.0:1789478506.956456:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478506.956535:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945517184 00000100:00100000:1.0:1789478506.956543:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945517184 00000100:00100000:1.0:1789478506.956626:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 34 00000100:00100000:1.0:1789478506.956636:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:0:x1876403945517184:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789478506.957238:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789478506.968934:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:0.0:1789478506.968948:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 327dd6d5-45fd-4b52-99bf-74d27d1ede6e 00000100:00100000:2.0:1789478506.979996:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:0:x1876403945517184:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 Request processed in 23351us (23535us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789478506.980009:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 34 00000100:00100000:3.0:1789478506.982457:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478506.982568:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945517440 00000100:00100000:2.0:1789478506.982576:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945517440 00000100:00100000:2.0:1789478506.982651:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:2.0:1789478506.983198:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+17:11275:x1876403945517440:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789478506.983464:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:11275:x1876403945517440:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 803us (1009us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1789478506.983472:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:1.0:1789478506.998674:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478507.001784:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945517696 00000100:00100000:3.0:1789478507.001797:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945517696 00000100:00100000:3.0:1789478507.001853:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 87 00000100:00100000:3.0:1789478507.001863:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:11275:x1876403945517696:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789478507.001987:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:11275:x1876403945517696:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 124us (3321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478507.001995:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 87 00000040:00080000:1.0:1789478507.011825:0:14201:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789478507.011833:0:14201:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789478507.011858:0:14201:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789478507.011863:0:14201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789478507.019545:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478507.019580:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945517824 00000100:00100000:1.0:1789478507.020202:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945517824 00000100:00100000:1.0:1789478507.020260:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 88 00000100:00100000:1.0:1789478507.020271:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:11275:x1876403945517824:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789478507.020289:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478507.020309:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e82163e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7387 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.020383:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82163ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.020395:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82163ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.021152:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82163ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478507.021193:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789478507.021208:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82163ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.021234:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e82163e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7387 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.021260:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82163ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7387 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.021269:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ebb024eed00) 00010000:00010000:1.0:1789478507.021271:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789478507.021274:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcea00, rc 0) 00000100:00100000:1.0:1789478507.021333:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+19:11275:x1876403945517824:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 1063us (1796us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478507.021341:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 88 00000100:00100000:1.0:1789478507.026275:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478507.026358:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945517952 00000100:00100000:3.0:1789478507.026376:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945517952 00000100:00100000:3.0:1789478507.026431:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 35 00000100:00100000:3.0:1789478507.026440:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2396:x1876403945517952:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789478507.026457:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478507.026479:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a2e0332/0x8ebaae74e82163f4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b738e expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789478507.026503:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9466a, blocks: 0x0 00010000:00010000:3.0:1789478507.026520:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=336s v=(0 0) 00010000:00010000:3.0:1789478507.026524:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478507.026533:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a2e0332/0x8ebaae74e82163f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b738e expref: 6 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.026554:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005a2e0332/0x8ebaae74e82163f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b738e expref: 6 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.026577:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fd800, rc 0) 00000100:00100000:3.0:1789478507.026855:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2396:x1876403945517952:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 414us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478507.026927:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 35 00000100:00100000:1.0:1789478507.029543:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478507.029630:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945518208 00000100:00100000:0.0:1789478507.029639:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945518208 00000100:00100000:0.0:1789478507.029787:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 89 00000100:00100000:0.0:1789478507.029797:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+19:11275:x1876403945518208:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789478507.029913:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+19:11275:x1876403945518208:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 117us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478507.029920:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 89 00010000:00010000:1.0:1789478507.044838:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478507.049938:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478507.050042:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945518336 00000100:00100000:3.0:1789478507.050052:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945518336 00000100:00100000:3.0:1789478507.050117:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 36 00000100:00100000:3.0:1789478507.050127:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:11275:x1876403945518336:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789478507.050144:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478507.050160:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6eaa1db/0x8ebaae74e82163fb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7395 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.050187:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005a2e0332/0x8ebaae74e82163f4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b738e expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.050196:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478507.050200:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478507.050205:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6eaa1db/0x8ebaae74e82163fb lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7395 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.050236:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005a2e0332/0x8ebaae74e82163f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b738e expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.050250:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005a2e0332/0x8ebaae74e82163f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b738e expref: 7 pid: 8431 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478507.050275:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1876403964464256:192.168.206.11@tcp:104: 00000100:00100000:3.0:1789478507.052957:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08f46600 going to sleep for 11 seconds 00000100:00100000:3.0:1789478507.057591:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1876403964464256:192.168.206.11@tcp:104: 00010000:00010000:3.0:1789478507.057642:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e6eaa1db/0x8ebaae74e82163fb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7395 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.057677:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fc000, rc 0) 00000100:00100000:3.0:1789478507.057734:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:11275:x1876403945518336:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 7608us (7804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478507.057742:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 36 00000100:00100000:3.0:1789478507.058900:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478507.060194:0:10392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945518464 00000100:00100000:0.0:1789478507.060204:0:10392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945518464 00010000:00010000:0.0:1789478507.060240:0:10392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005a2e0332/0x8ebaae74e82163f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b738e expref: 7 pid: 8431 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478507.060280:0:10392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 59 00000100:00100000:0.0:1789478507.060289:0:10392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2395:x1876403945518464:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478507.060301:0:10392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478507.060322:0:10392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a2e0332/0x8ebaae74e82163f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b738e expref: 7 pid: 8431 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.060336:0:10392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a2e0332/0x8ebaae74e82163f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b738e expref: 7 pid: 8431 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.060357:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a2e0332/0x8ebaae74e82163f4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b738e expref: 7 pid: 8431 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.060381:0:10392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478507.060386:0:10392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478507.060393:0:10392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6eaa1db/0x8ebaae74e82163fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7395 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.060418:0:10392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6eaa1db/0x8ebaae74e82163fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7395 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.060452:0:10392:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e6eaa1db/0x8ebaae74e82163fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7395 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478507.060465:0:10392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c69880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10392:1876403964464384:192.168.206.11@tcp:105: 00000100:00100000:0.0:1789478507.060525:0:10392:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc3c8a6180 going to sleep for 11 seconds 00000100:00100000:0.0:1789478507.071828:0:10392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c69880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10392:1876403964464384:192.168.206.11@tcp:105: 00010000:00010000:0.0:1789478507.071851:0:10392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478507.071915:0:10392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2395:x1876403945518464:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 11626us (13018us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478507.071927:0:10392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 59 00000100:00100000:3.0:1789478507.076942:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478507.077840:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945518592 00000100:00100000:0.0:1789478507.077850:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945518592 00002000:00100000:0.0:1789478507.077905:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8ebb035a7100 x1876403945518592/t0(0) o4->327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp:168/0 lens 504/0 e 0 to 0 dl 1789478518 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789478507.077917:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ebb035a7100 with x1876403945518592 ext(0->8) 00002000:00010000:0.0:1789478507.077922:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ebb035a7100 00000100:00100000:0.0:1789478507.078057:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:0.0:1789478507.078068:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2395:x1876403945518592:12345-192.168.206.11@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789478507.084029:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2395:x1876403945518592:12345-192.168.206.11@tcp:4:lhsmtool_posix.0 Request processed in 5946us (7078us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789478507.084056:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 0 00002000:00100000:0.0:1789478507.084069:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8ebb035a7100 x1876403945518592/t4294967303(0) o4->327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp:168/0 lens 504/448 e 0 to 0 dl 1789478518 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789478507.084079:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ebb035a7100 with x1876403945518592 ext(0->8) 00002000:00010000:0.0:1789478507.084086:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ebb035a7100 00000100:00100000:2.0:1789478507.087969:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478507.090153:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945518720 00000100:00100000:3.0:1789478507.090165:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945518720 00000100:00100000:3.0:1789478507.090218:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 90 00000100:00100000:3.0:1789478507.090228:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+19:11275:x1876403945518720:12345-192.168.206.11@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789478507.098291:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1789478507.098307:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789478507.098330:0:6496:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1789478507.098351:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1789478507.098358:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789478507.098583:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+15:11275:x1876403945518720:12345-192.168.206.11@tcp:44:lhsmtool_posix.0 Request processed in 8351us (10615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478507.098618:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 90 00000100:00100000:0.0:1789478507.099896:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789478507.099913:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964464512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789478507.099974:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478507.100352:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964464512 00000100:00100000:0.0:1789478507.100370:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964464512 00000100:00100000:0.0:1789478507.100422:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789478507.100432:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964464512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789478507.100539:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789478507.100543:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789478506 00002000:00010000:0.0:1789478507.100545:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789478507.100547:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789478506 -> 1789478506 00002000:00010000:0.0:1789478507.100549:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789478507.100587:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876403964464512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 157us (624us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789478507.100621:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1789478507.100642:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789478507.100744:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ebb03c69880/2, rc 0, transno 4294967304 00000100:00100000:0.0:1789478507.100750:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964464512:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789478507.101907:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478507.103128:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945518848 00000100:00100000:0.0:1789478507.103138:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945518848 00000100:00100000:0.0:1789478507.103193:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 38 00000100:00100000:0.0:1789478507.103203:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2395:x1876403945518848:12345-192.168.206.11@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789478507.105329:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1789478507.105341:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00010000:00010000:1.0:1789478507.106763:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82163d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.106779:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82163d1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.106799:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82163d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.106806:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfe00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478507.106811:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82163d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.106818:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82163d1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.106835:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ebb024eed00) 00010000:00010000:1.0:1789478507.106839:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789478507.106843:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82163d1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.106850:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82163d1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478507.111771:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2395:x1876403945518848:12345-192.168.206.11@tcp:16:lhsmtool_posix.0 Request processed in 8559us (9857us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478507.111785:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 38 00000100:00100000:3.0:1789478507.114305:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478507.115774:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945519104 00000100:00100000:1.0:1789478507.115785:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945519104 00000100:00100000:1.0:1789478507.115846:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 91 00000100:00100000:1.0:1789478507.115857:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+14:11275:x1876403945519104:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789478507.116080:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478507.116201:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82163ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7387 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.116218:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ebb024eed00) 00010000:00010000:1.0:1789478507.116223:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789478507.116256:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216402 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.116269:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216402 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.116280:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216402 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789478507.116400:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000001c6ca9 reply state 0000000051a9f857 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216402 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.116412:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216402 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.116418:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ebb024eed00) 00010000:00010000:1.0:1789478507.116421:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789478507.116423:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789478507.116508:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+15:11275:x1876403945519104:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 653us (2210us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1789478507.116516:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 91 00000100:00100000:2.0:1789478507.125425:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478507.126169:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945519232 00000100:00100000:3.0:1789478507.126178:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945519232 00000100:00100000:3.0:1789478507.126229:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 39 00000100:00100000:3.0:1789478507.126238:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2396:x1876403945519232:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789478507.126381:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789478507.126385:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789478506 -> 1789478505 00002000:00010000:3.0:1789478507.126388:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789478504 00002000:00010000:3.0:1789478507.126390:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789478506 -> 1789478505 00002000:00010000:3.0:1789478507.126392:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789478507.126444:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2396:x1876403945519232:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 Request processed in 207us (1026us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789478507.126452:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 39 00000100:00100000:1.0:1789478507.140464:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478507.140534:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945519488 00000100:00100000:3.0:1789478507.140543:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945519488 00000100:00100000:3.0:1789478507.140631:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 92 00000100:00100000:3.0:1789478507.140640:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+15:11275:x1876403945519488:12345-192.168.206.11@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789478507.140704:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216409 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.140721:0:10096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82163ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7379 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.140730:0:10096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216409 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.140762:0:10096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82163ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7379 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.140788:0:10096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82163ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7379 expref: 15 pid: 6517 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478507.140801:0:10096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10096:1876403964464640:192.168.206.11@tcp:104: 00000100:00100000:3.0:1789478507.140882:0:10096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08f46600 going to sleep for 11 seconds 00000100:00100000:0.0:1789478507.149407:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478507.149444:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945519616 00000100:00100000:0.0:1789478507.149451:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945519616 00010000:00010000:0.0:1789478507.149485:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82163ca lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7379 expref: 16 pid: 6517 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478507.149517:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 60 00000100:00100000:0.0:1789478507.149527:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+16:2395:x1876403945519616:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478507.149540:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478507.149547:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82163ca lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7379 expref: 16 pid: 6517 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.149561:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82163ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7379 expref: 16 pid: 6517 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.149580:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ebb024eed00) 00010000:00010000:0.0:1789478507.149585:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216409 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.149620:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216409 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.149629:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216409 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.149658:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478507.149702:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+16:2395:x1876403945519616:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 177us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478507.149710:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 60 00010000:00010000:3.0:1789478507.149796:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82163ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7379 expref: 15 pid: 6517 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478507.149809:0:10096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10096:1876403964464640:192.168.206.11@tcp:104: 00010000:00010000:3.0:1789478507.149827:0:10096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216409 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.149835:0:10096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216409 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.149841:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216409 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.149887:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216409 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.149895:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216409 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.149901:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216409 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.149907:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478507.149918:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216409 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.149926:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216409 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.149935:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ebb024eed00) 00010000:00010000:3.0:1789478507.149938:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789478507.149941:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216409 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.149947:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216409 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478507.149994:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+14:11275:x1876403945519488:12345-192.168.206.11@tcp:55:lhsmtool_posix.0 Request processed in 9355us (9538us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789478507.150002:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 92 00000100:00100000:1.0:1789478507.161464:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478507.165713:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945519744 00000100:00100000:3.0:1789478507.165726:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945519744 00000100:00100000:0.0:1789478507.166375:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 40 00000100:00100000:0.0:1789478507.166458:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2396:x1876403945519744:12345-192.168.206.11@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789478507.166514:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b926601b/0x8ebaae74e8216410 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.166534:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6eaa1db/0x8ebaae74e82163fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7395 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.166543:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478507.166547:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789478507.166551:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b926601b/0x8ebaae74e8216410 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.166585:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e6eaa1db/0x8ebaae74e82163fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7395 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.166629:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e6eaa1db/0x8ebaae74e82163fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7395 expref: 7 pid: 8430 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478507.166644:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1876403964464768:192.168.206.11@tcp:104: 00000100:00100000:0.0:1789478507.166724:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc3c8a6180 going to sleep for 11 seconds 00000100:00100000:3.0:1789478507.173813:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1876403964464768:192.168.206.11@tcp:104: 00010000:00010000:3.0:1789478507.173843:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b926601b/0x8ebaae74e8216410 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478507.180675:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478507.184524:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945519872 00000100:00100000:3.0:1789478507.184537:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945519872 00010000:00010000:3.0:1789478507.184582:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e6eaa1db/0x8ebaae74e82163fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7395 expref: 8 pid: 8430 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478507.185828:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 61 00000100:00100000:3.0:1789478507.185842:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2396:x1876403945519872:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789478507.185866:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478507.185886:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e6eaa1db/0x8ebaae74e82163fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7395 expref: 8 pid: 8430 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.185901:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e6eaa1db/0x8ebaae74e82163fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7395 expref: 8 pid: 8430 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.185922:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6eaa1db/0x8ebaae74e82163fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7395 expref: 8 pid: 8430 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.185935:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789478507.185940:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789478507.185945:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b926601b/0x8ebaae74e8216410 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.185955:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b926601b/0x8ebaae74e8216410 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.185981:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478507.186108:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2396:x1876403945519872:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 269us (5439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478507.186116:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 61 00010000:00010000:0.0:1789478507.192949:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b926601b/0x8ebaae74e8216410 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.192966:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b926601b/0x8ebaae74e8216410 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.192995:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b926601b/0x8ebaae74e8216410 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.193003:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b926601b/0x8ebaae74e8216410 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.193789:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b926601b/0x8ebaae74e8216410 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.193798:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67400 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:0.0:1789478507.193802:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b926601b/0x8ebaae74e8216410 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.193812:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b926601b/0x8ebaae74e8216410 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.193831:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b926601b/0x8ebaae74e8216410 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.193838:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b926601b/0x8ebaae74e8216410 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478507.194207:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2396:x1876403945519744:12345-192.168.206.11@tcp:1:lhsmtool_posix.0 Request processed in 27817us (32747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478507.194217:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 40 00000100:00100000:1.0:1789478507.200522:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478507.202165:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945520128 00000100:00100000:0.0:1789478507.202176:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945520128 00000100:00100000:0.0:1789478507.202227:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 93 00000100:00100000:0.0:1789478507.202237:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+14:11275:x1876403945520128:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789478507.203177:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216417 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.203197:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216257 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b731e expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.203207:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216417 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.203240:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216257 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b731e expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.203254:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216257 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b731e expref: 14 pid: 6517 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478507.203267:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c68e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964464896:192.168.206.11@tcp:104: 00000100:00100000:0.0:1789478507.203571:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc3c8a6600 going to sleep for 11 seconds 00000100:00100000:1.0:1789478507.217809:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c68e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964464896:192.168.206.11@tcp:104: 00010000:00010000:1.0:1789478507.217837:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216417 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478507.236898:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478507.237096:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb035eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964465024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789478507.237149:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478507.237191:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964465024 00000100:00100000:1.0:1789478507.237197:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964465024 00000100:00100000:1.0:1789478507.237231:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789478507.237238:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964465024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789478507.237265:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789478507.237715:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964465024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 475us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478507.237723:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789478507.237763:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb035eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964465024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789478507.238570:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964465152:0@lo:400:kworker.0 00000100:00100000:3.0:1789478507.238633:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478507.238731:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964465664:0@lo:400:kworker.0 00000100:00100000:3.0:1789478507.238757:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478507.238783:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876403964466176:0@lo:400:kworker.0 00000100:00100000:3.0:1789478507.238805:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478507.238825:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789478507.238831:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964465280:0@lo:400:kworker.0 00000100:00100000:3.0:1789478507.238850:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478507.238928:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964465792:0@lo:400:kworker.0 00000100:00100000:1.0:1789478507.239178:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964465152 00000100:00100000:1.0:1789478507.239184:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964465152 00000100:00100000:1.0:1789478507.239217:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1789478507.239224:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964465152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478507.239258:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964465152:12345-0@lo:400:kworker.0 Request processed in 35us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478507.239265:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1789478507.239737:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964465664 00000100:00100000:1.0:1789478507.239743:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964465664 00000100:00100000:1.0:1789478507.239781:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964466176 00000100:00100000:1.0:1789478507.239784:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964466176 00000100:00100000:1.0:1789478507.239797:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964465280 00000100:00100000:1.0:1789478507.239799:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964465280 00000100:00100000:1.0:1789478507.239809:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789478507.239815:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964465664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478507.239848:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964465664:12345-0@lo:400:kworker.0 Request processed in 34us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478507.240168:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478507.240187:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964466304:0@lo:400:kworker.0 00000100:00100000:3.0:1789478507.240210:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478507.240232:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964465152:0@lo:400:kworker.0 00000100:00100000:3.0:1789478507.240244:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964465664:0@lo:400:kworker.0 00000100:00100000:3.0:1789478507.240292:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964465792 00000100:00100000:3.0:1789478507.240295:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964465792 00000100:00100000:3.0:1789478507.240316:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964466304 00000100:00100000:3.0:1789478507.240318:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964466304 00000100:00100000:3.0:1789478507.240332:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789478507.240338:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876403964466176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478507.240452:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876403964466176:12345-0@lo:400:kworker.0 Request processed in 114us (1645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478507.240459:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789478507.240475:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789478507.240481:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964465280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478507.240511:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964465280:12345-0@lo:400:kworker.0 Request processed in 30us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478507.240517:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789478507.240539:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789478507.240545:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964465792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478507.240572:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964465792:12345-0@lo:400:kworker.0 Request processed in 28us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478507.240578:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789478507.240590:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789478507.240613:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964466304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478507.240639:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964466304:12345-0@lo:400:kworker.0 Request processed in 28us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478507.240645:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789478507.240688:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964465280:0@lo:400:kworker.0 00010000:00080000:3.0:1789478507.240701:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40ed4380 x1876403964465792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478507.240711:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964465792:0@lo:400:kworker.0 00010000:00080000:3.0:1789478507.240719:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40ed7480 x1876403964466304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478507.240728:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964466304:0@lo:400:kworker.0 00000100:00100000:3.0:1789478507.240737:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876403964466176:0@lo:400:kworker.0 00000100:00100000:1.0:1789478507.240989:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00080000:1.0:1789478507.241027:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789478507.241031:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789478507.241046:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964465408:0@lo:400:kworker.0 00000100:00100000:1.0:1789478507.241078:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478507.241110:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964465920:0@lo:400:kworker.0 00000100:00100000:1.0:1789478507.241146:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478507.241167:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964466432:0@lo:400:kworker.0 00000100:00100000:1.0:1789478507.241188:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478507.241205:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789478507.241210:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964465536:0@lo:400:kworker.0 00000100:00100000:1.0:1789478507.241228:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478507.241243:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964466048:0@lo:400:kworker.0 00000100:00100000:1.0:1789478507.241262:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478507.241515:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964465920 00000100:00100000:1.0:1789478507.241520:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964465920 00000100:00100000:1.0:1789478507.241556:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964466432 00000100:00100000:1.0:1789478507.241559:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964466432 00000100:00100000:1.0:1789478507.241571:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964466048 00000100:00100000:1.0:1789478507.241574:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964466048 00000100:00100000:1.0:1789478507.241585:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789478507.241615:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964465920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478507.241666:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964465920:12345-0@lo:400:kworker.0 Request processed in 62us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478507.241673:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789478507.241687:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789478507.241700:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964466432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478507.241730:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964466432:12345-0@lo:400:kworker.0 Request processed in 31us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478507.241736:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789478507.241749:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789478507.241755:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3645:x1876403964466048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478507.241779:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3645:x1876403964466048:12345-0@lo:400:kworker.0 Request processed in 25us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478507.241784:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1789478507.241801:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789478507.241804:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789478507.241827:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964466048:0@lo:400:kworker.0 00000100:00100000:1.0:1789478507.241837:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964465920:0@lo:400:kworker.0 00000100:00100000:1.0:1789478507.241845:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964466432:0@lo:400:kworker.0 00000100:00100000:1.0:1789478507.241941:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964465536 00000100:00100000:1.0:1789478507.241945:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964465536 00000100:00100000:1.0:1789478507.241971:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789478507.241977:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964465536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478507.242173:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964465536:12345-0@lo:400:kworker.0 Request processed in 195us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478507.242180:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789478507.242206:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964465536:0@lo:400:kworker.0 00000100:00100000:3.0:1789478507.245893:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964465408 00000100:00100000:3.0:1789478507.245905:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964465408 00000100:00100000:3.0:1789478507.245956:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789478507.245965:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964465408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478507.246061:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964465408:12345-0@lo:400:kworker.0 Request processed in 96us (4981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478507.246078:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789478507.246490:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964465408:0@lo:400:kworker.0 00000100:00100000:1.0:1789478507.246509:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789478507.246526:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964466560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478507.246561:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478507.246612:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964466560 00000100:00100000:1.0:1789478507.246616:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964466560 00000100:00100000:1.0:1789478507.246645:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789478507.246651:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964466560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789478507.246688:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789478507.246725:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964466560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478507.246731:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789478507.246763:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964466560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478507.249797:0:10392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945520256 00000100:00100000:1.0:1789478507.249811:0:10392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945520256 00010000:00010000:1.0:1789478507.249856:0:10392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216257 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b731e expref: 15 pid: 6517 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478507.249906:0:10392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 62 00000100:00100000:1.0:1789478507.249916:0:10392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08340850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+15:2395:x1876403945520256:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789478507.249929:0:10392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478507.249936:0:10392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216257 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b731e expref: 15 pid: 6517 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.249949:0:10392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216257 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b731e expref: 15 pid: 6517 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.249980:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216257 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b731e expref: 15 pid: 6517 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.250449:0:10392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:1.0:1789478507.250456:0:10392:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216417 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.250467:0:10392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216417 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.250474:0:10392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216417 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.250501:0:10392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478507.250556:0:10392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08340850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+14:2395:x1876403945520256:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 641us (13667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478507.250563:0:10392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 62 00010000:00010000:1.0:1789478507.250646:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216417 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.250666:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216417 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.250852:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821641e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.251344:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82163d8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7380 expref: 14 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.251355:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821641e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.251469:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82163d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7380 expref: 14 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.251491:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82163d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7380 expref: 14 pid: 13638 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478507.251505:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964466688:192.168.206.11@tcp:104: 00000100:00100000:1.0:1789478507.251558:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05488540 going to sleep for 11 seconds 00000100:00100000:0.0:1789478507.261270:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478507.261332:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945520384 00000100:00100000:3.0:1789478507.261341:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945520384 00010000:00010000:3.0:1789478507.261387:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82163d8 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7380 expref: 15 pid: 13638 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478507.261425:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 63 00000100:00100000:3.0:1789478507.261435:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+15:2395:x1876403945520384:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789478507.261469:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478507.261477:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82163d8 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7380 expref: 15 pid: 13638 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.261491:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82163d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7380 expref: 15 pid: 13638 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.261512:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ebb024eed00) 00010000:00010000:3.0:1789478507.261518:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821641e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.261527:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821641e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.261534:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821641e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.261551:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478507.261620:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+15:2395:x1876403945520384:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 186us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478507.261638:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 63 00010000:00010000:1.0:1789478507.261850:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e82163d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7380 expref: 14 pid: 13638 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478507.261871:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964466688:192.168.206.11@tcp:104: 00010000:00010000:1.0:1789478507.261891:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821641e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.261901:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821641e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478507.261906:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821641e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789478507.263093:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1789478507.263565:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1789478507.263669:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1789478507.263748:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6519:1876403964466816:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789478507.263806:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478507.263888:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05488e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789478507.264877:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964466816 00000100:00100000:0.0:1789478507.264896:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964466816 00000100:00100000:1.0:1789478507.265131:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789478507.265141:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6519:x1876403964466816:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789478507.265258:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6519:x1876403964466816:12345-0@lo:1000:mdt00_002.0 Request processed in 118us (1451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478507.265265:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789478507.265336:0:6519:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1789478507.265342:0:6519:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ebb03c69880, transno 4294967304 00000100:00100000:3.0:1789478507.265371:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6519:1876403964466816:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789478507.265494:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1789478507.265554:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03dff100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6519:1876403964466944:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789478507.265588:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478507.265632:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05488780 going to sleep for 11 seconds 00000100:00100000:3.0:1789478507.265647:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964466944 00000100:00100000:3.0:1789478507.265651:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964466944 00000100:00100000:3.0:1789478507.265677:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789478507.265684:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6519:x1876403964466944:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789478507.265773:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6519:x1876403964466944:12345-0@lo:1000:mdt00_002.0 Request processed in 89us (184us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789478507.265780:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789478507.265811:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03dff100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6519:1876403964466944:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789478507.265841:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821641e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.265850:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821641e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.265857:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821641e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.265875:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfc00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478507.265880:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821641e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.265896:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821641e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.265910:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ebb024eed00) 00010000:00010000:3.0:1789478507.265913:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789478507.265917:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821641e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.265923:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821641e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.265949:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e821634c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.265955:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e821634c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.265973:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e821634c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.265978:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcf600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478507.265981:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e821634c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.265987:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e821634c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.265995:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:3.0:1789478507.265997:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789478507.266000:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e821634c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.266016:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e821634c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.266039:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216425 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.266054:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216368 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7364 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.266062:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216425 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.266084:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216368 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7364 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.266096:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216368 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7364 expref: 17 pid: 6519 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478507.266107:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03dfc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964467072:192.168.206.11@tcp:104: 00000100:00100000:3.0:1789478507.266159:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095b10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478507.269456:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478507.269487:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945520512 00000100:00100000:0.0:1789478507.269494:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945520512 00010000:00010000:0.0:1789478507.269528:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216368 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7364 expref: 18 pid: 6519 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478507.269562:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 64 00000100:00100000:0.0:1789478507.269572:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:2396:x1876403945520512:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478507.269585:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478507.269614:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216368 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7364 expref: 18 pid: 6519 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.269627:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216368 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7364 expref: 18 pid: 6519 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.269648:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:0.0:1789478507.269654:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216425 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.269664:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216425 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.269671:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216425 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478507.269688:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478507.269732:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:2396:x1876403945520512:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 161us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478507.269740:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 64 00010000:00010000:3.0:1789478507.270647:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216368 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7364 expref: 17 pid: 6519 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478507.270666:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03dfc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964467072:192.168.206.11@tcp:104: 00010000:00010000:3.0:1789478507.270685:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216425 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.270693:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216425 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.270708:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216425 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.270720:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216425 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.270726:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216425 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.270732:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216425 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.270739:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fc000 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478507.270743:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216425 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.270751:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216425 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.270762:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:3.0:1789478507.270765:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478507.270769:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216425 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.270775:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e8216425 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.270785:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216417 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.270791:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216417 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.270802:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216417 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.270807:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67c00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478507.270811:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216417 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.270817:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216417 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.270826:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb02503100) 00010000:00010000:3.0:1789478507.270828:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789478507.270831:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216417 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.270837:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216417 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478507.271087:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+16:11275:x1876403945520128:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 68849us (70570us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1789478507.271153:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 93 00000020:00080000:3.0:1789478507.271159:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789478507.271439:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789478507.271444:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789478507.271460:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789478507.271466:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789478507.273716:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478507.273785:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945520768 00000100:00100000:2.0:1789478507.273795:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945520768 00000100:00100000:2.0:1789478507.273843:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:2.0:1789478507.273852:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+16:11275:x1876403945520768:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789478507.274291:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789478507.274320:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:2.0:1789478507.274350:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e821642c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478507.274375:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e821642c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478507.274385:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e821642c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478507.274394:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e821642c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478507.274400:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e821642c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478507.274418:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e821642c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478507.274474:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789478507.274556:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:11275:x1876403945520768:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 704us (847us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1789478507.274565:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 20 00000020:00080000:2.0:1789478507.274569:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789478507.276494:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789478507.276504:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e821642c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.276514:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76800 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478507.276519:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e821642c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.276544:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e821642c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.276560:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ebb024eed00) 00010000:00010000:3.0:1789478507.276564:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789478507.276568:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e821642c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478507.276574:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e821642c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478507.276793:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478507.276796:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478507.276797:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478507.750265:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789478507.750287:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964467200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789478507.750354:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478507.751331:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964467200 00000100:00100000:2.0:1789478507.751339:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964467200 00000100:00100000:2.0:1789478507.751391:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789478507.751400:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964467200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789478507.751422:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1789478507.751525:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964467200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478507.751533:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789478507.751645:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964467200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789478507.752892:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789478507.752907:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03dfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964467328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789478507.752953:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478507.753121:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964467328 00000100:00100000:3.0:1789478507.753128:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964467328 00000100:00100000:3.0:1789478507.753543:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789478507.753553:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876403964467328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789478507.753571:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1789478507.753667:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876403964467328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478507.753674:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789478507.753780:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03dfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964467328:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789478508.069157:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789478508.834981:0:14252:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789478508.834989:0:14252:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789478508.835013:0:14252:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789478508.835019:0:14252:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789478508.942997:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478508.943255:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945521024 00000100:00100000:3.0:1789478508.943263:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945521024 00000100:00100000:3.0:1789478508.943331:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 94 00000100:00080000:0.0:1789478508.943340:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789478508.943342:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:11293:x1876403945521024:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1789478508.943378:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478508.943397:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216433 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b739c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478508.943510:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e821643a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478508.943523:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e821643a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478508.943535:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e821643a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478508.943546:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789478508.943654:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216433 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b739c expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478508.943670:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e821643a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b739c expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478508.943680:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:3.0:1789478508.943683:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789478508.943686:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fc000, rc 0) 00000100:00100000:3.0:1789478508.943741:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+20:11293:x1876403945521024:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 401us (752us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789478508.943748:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 94 00000100:00100000:0.0:1789478508.948054:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478508.948088:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945521152 00000100:00100000:0.0:1789478508.948097:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945521152 00000100:00100000:0.0:1789478508.948146:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 95 00000100:00100000:0.0:1789478508.948157:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+20:11293:x1876403945521152:12345-192.168.206.11@tcp:34:lfs.0 00010000:00010000:0.0:1789478508.948230:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216448 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948247:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216448 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948398:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216448 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948418:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821644f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948426:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821644f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948434:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821644f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948518:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216456 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948532:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216456 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948539:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216456 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789478508.948582:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216456 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948616:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216448 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948623:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216448 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948629:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216448 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948635:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478508.948639:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216448 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948646:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216448 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948657:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:0.0:1789478508.948660:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478508.948665:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216448 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948671:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216448 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948689:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821644f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948695:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821644f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948701:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821644f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948706:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67e00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478508.948709:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821644f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948715:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821644f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948723:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ebc40e80900) 00010000:00010000:0.0:1789478508.948725:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478508.948728:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821644f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948734:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821644f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948747:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216456 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948753:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216456 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948759:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216456 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948769:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67c00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478508.948772:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216456 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948778:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216456 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948787:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:0.0:1789478508.948789:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478508.948791:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216456 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478508.948796:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216456 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478508.949044:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+20:11293:x1876403945521152:12345-192.168.206.11@tcp:34:lfs.0 Request processed in 886us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478508.949052:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 95 00000100:00100000:1.0:1789478509.005050:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478509.005093:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945521408 00000100:00100000:1.0:1789478509.005102:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945521408 00000100:00100000:1.0:1789478509.005152:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 96 00000100:00100000:1.0:1789478509.005162:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+20:11296:x1876403945521408:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1789478509.005179:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478509.005198:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e821645d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b73a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005263:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216464 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005277:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216464 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005298:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216464 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005313:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821646b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005321:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821646b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005327:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821646b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005438:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e8216472 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005447:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e8216472 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005454:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e8216472 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478509.005463:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789478509.005526:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216464 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005533:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216464 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005539:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216464 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005544:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fce600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478509.005554:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216464 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005562:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216464 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005574:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:1.0:1789478509.005577:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478509.005581:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216464 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005586:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216464 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005617:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821646b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005624:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821646b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005630:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821646b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005634:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fce800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478509.005636:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821646b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005641:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821646b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005649:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ebb024ee500) 00010000:00010000:1.0:1789478509.005651:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478509.005659:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821646b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005665:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e821646b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005703:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e821645d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73a3 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005716:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e8216472 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73a3 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.005723:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb024ee600) 00010000:00010000:1.0:1789478509.005725:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789478509.005728:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcf600, rc 0) 00000100:00100000:1.0:1789478509.005779:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+22:11296:x1876403945521408:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 619us (735us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789478509.005787:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 96 00000100:00100000:0.0:1789478509.010030:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478509.011002:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945521536 00000100:00100000:1.0:1789478509.011014:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945521536 00000100:00100000:1.0:1789478509.011071:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 97 00000100:00100000:1.0:1789478509.011082:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+22:11296:x1876403945521536:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:1.0:1789478509.011144:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8216480 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.011161:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8216480 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.011177:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8216480 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.011223:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8216480 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.011230:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8216480 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.011235:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8216480 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.011241:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcea00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478509.011245:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8216480 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.011252:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8216480 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.011263:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb024ee600) 00010000:00010000:1.0:1789478509.011266:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789478509.011270:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8216480 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.011276:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8216480 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478509.011342:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+22:11296:x1876403945521536:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 261us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478509.011362:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 97 00000100:00100000:1.0:1789478509.013019:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478509.013113:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945521792 00000100:00100000:0.0:1789478509.013121:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945521792 00000100:00100000:0.0:1789478509.013167:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:0.0:1789478509.013177:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc0838e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+22:11296:x1876403945521792:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:0.0:1789478509.013338:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc0838e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+23:11296:x1876403945521792:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 163us (324us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1789478509.013345:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:1.0:1789478509.045945:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478509.046033:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945522048 00000100:00100000:0.0:1789478509.046042:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945522048 00000100:00100000:0.0:1789478509.046136:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 98 00000100:00100000:0.0:1789478509.046147:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+23:10815:x1876403945522048:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:0.0:1789478509.046168:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478509.046185:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e8216487 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b73aa expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.046272:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e821648e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.046285:0:10096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e8216472 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73a3 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.046294:0:10096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e821648e lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.046324:0:10096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e8216472 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73a3 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.046336:0:10096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e8216472 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73a3 expref: 24 pid: 6519 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478509.046364:0:10096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10096:1876403964467456:192.168.206.11@tcp:104: 00000100:00100000:0.0:1789478509.046441:0:10096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc3c8a6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789478509.057969:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478509.058038:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945522176 00000100:00100000:2.0:1789478509.058046:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945522176 00010000:00010000:2.0:1789478509.058080:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e8216472 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73a3 expref: 25 pid: 6519 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478509.058119:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 65 00000100:00100000:2.0:1789478509.058140:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+25:2395:x1876403945522176:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789478509.058152:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478509.058159:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e8216472 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73a3 expref: 25 pid: 6519 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478509.058173:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e8216472 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73a3 expref: 25 pid: 6519 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478509.058193:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb024ee600) 00010000:00010000:2.0:1789478509.058198:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e821648e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478509.058207:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e821648e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478509.058215:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e821648e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478509.058230:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478509.058278:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+25:2395:x1876403945522176:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 140us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478509.058285:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 65 00010000:00010000:1.0:1789478509.058636:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e8216472 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73a3 expref: 24 pid: 6519 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478509.058658:0:10096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10096:1876403964467456:192.168.206.11@tcp:104: 00010000:00010000:1.0:1789478509.058676:0:10096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e821648e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.058683:0:10096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e821648e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.058690:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e821648e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478509.058706:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789478509.058808:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e8216487 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73aa expref: 25 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.058825:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e821648e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73aa expref: 24 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.058833:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb024ee600) 00010000:00010000:1.0:1789478509.058836:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789478509.058838:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc421eca00, rc 0) 00000100:00100000:1.0:1789478509.058881:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+24:10815:x1876403945522048:12345-192.168.206.11@tcp:101:bash.0 Request processed in 12737us (12945us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1789478509.058888:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 98 00000100:00100000:1.0:1789478509.067785:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478509.068005:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945522304 00000100:00100000:3.0:1789478509.068015:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945522304 00000100:00100000:3.0:1789478509.068072:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 99 00000100:00100000:3.0:1789478509.068082:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+24:10815:x1876403945522304:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:3.0:1789478509.068103:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478509.068132:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e821649c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b73b1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.068165:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82164a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.068179:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82164a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.068190:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82164a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.068299:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e821649c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73b1 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.068326:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82164a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73b1 expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.068335:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb024ee600) 00010000:00010000:3.0:1789478509.068338:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789478509.068342:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fce00, rc 0) 00000100:00100000:3.0:1789478509.068410:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+25:10815:x1876403945522304:12345-192.168.206.11@tcp:101:bash.0 Request processed in 330us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478509.068417:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 99 00000100:00100000:2.0:1789478509.073204:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478509.073409:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945522560 00000100:00100000:1.0:1789478509.073418:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945522560 00000100:00100000:1.0:1789478509.073478:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 100 00000100:00100000:1.0:1789478509.073500:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+25:10815:x1876403945522560:12345-192.168.206.11@tcp:36:bash.0 00010000:00010000:1.0:1789478509.073725:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82164aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.073740:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82164aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.073752:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82164aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789478509.073792:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1789478509.073811:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000321486ab reply state 0000000079325910 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82164aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.073822:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82164aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.073829:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb024ee600) 00010000:00010000:1.0:1789478509.073832:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789478509.073835:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789478509.073865:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1789478509.073938:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+29:10815:x1876403945522560:12345-192.168.206.11@tcp:36:bash.0 Request processed in 439us (742us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789478509.073945:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 100 00000020:00080000:1.0:1789478509.073950:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789478509.081388:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478509.083866:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945522688 00000100:00100000:1.0:1789478509.083878:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945522688 00000100:00100000:1.0:1789478509.083948:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 101 00000100:00100000:1.0:1789478509.083958:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+29:10815:x1876403945522688:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:1.0:1789478509.083979:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478509.084008:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82164b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b73b8 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.084066:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82164b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73b8 expref: 30 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.084080:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82164b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73b8 expref: 30 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.084097:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb024ee600) 00010000:00010000:1.0:1789478509.084100:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789478509.084104:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcea00, rc 0) 00000100:00100000:1.0:1789478509.084164:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+30:10815:x1876403945522688:12345-192.168.206.11@tcp:101:bash.0 Request processed in 207us (2784us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478509.084238:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 101 00000100:00100000:0.0:1789478509.088365:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478509.088515:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945522816 00000100:00100000:1.0:1789478509.088524:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945522816 00000100:00100000:1.0:1789478509.088639:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 41 00000100:00100000:1.0:1789478509.088650:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:10815:x1876403945522816:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:1.0:1789478509.088665:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478509.088683:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cbc0e46/0x8ebaae74e82164b8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b73bf expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789478509.088706:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa94669, atime: 0x6aa94668, ctime: 0x6aa94669, blocks: 0x8 00010000:00010000:1.0:1789478509.088726:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=338s v=(0 0) 00010000:00010000:1.0:1789478509.088730:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478509.088739:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cbc0e46/0x8ebaae74e82164b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73bf expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.088771:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004cbc0e46/0x8ebaae74e82164b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73bf expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.088782:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcf200, rc 0) 00000100:00100000:1.0:1789478509.088831:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:10815:x1876403945522816:12345-192.168.206.11@tcp:101:bash.0 Request processed in 183us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478509.088839:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 41 00000100:00080000:0.0:1789478509.088906:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789478509.092794:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478509.097083:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478509.097508:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945522944 00000100:00100000:0.0:1789478509.097527:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945522944 00002000:00010000:0.0:1789478509.097558:0:8435:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1789478509.097562:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ebb03785c00 with x1876403945522944 ext(0->18446744073709551615) 00002000:00010000:0.0:1789478509.097572:0:8435:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ebb03785c00. 00000100:00100000:0.0:1789478509.097671:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 1 00000100:00100000:0.0:1789478509.097680:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2395:x1876403945522944:12345-192.168.206.11@tcp:10:bash.0 00002000:00010000:0.0:1789478509.097897:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789478509.097901:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789478505 -> 1789478508 00002000:00010000:0.0:1789478509.097904:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1789478504 -> 1789478504 00002000:00010000:0.0:1789478509.097906:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789478505 -> 1789478508 00002000:00010000:0.0:1789478509.097908:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1789478509.097952:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2395:x1876403945522944:12345-192.168.206.11@tcp:10:bash.0 Request processed in 273us (875us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789478509.097959:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 1 00002000:00010000:0.0:1789478509.097962:0:8435:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1789478509.097964:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ebb03785c00 with x1876403945522944 ext(0->18446744073709551615) 00002000:00010000:0.0:1789478509.097969:0:8435:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ebb03785c00. 00000100:00100000:3.0:1789478509.157889:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478509.158118:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945523072 00000100:00100000:1.0:1789478509.158129:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945523072 00000100:00100000:1.0:1789478509.158184:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 102 00000100:00100000:1.0:1789478509.158198:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+30:11310:x1876403945523072:12345-192.168.206.11@tcp:34:lfs.0 00010000:00010000:1.0:1789478509.158263:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e82164bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158279:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e82164bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158289:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e82164bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158303:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e82164c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158315:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e82164c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158321:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e82164c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158404:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158412:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158419:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789478509.158468:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158478:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e82164bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158484:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e82164bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158491:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e82164bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158498:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fce600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478509.158502:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e82164bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158508:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e82164bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158518:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:1.0:1789478509.158712:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478509.158718:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e82164bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158731:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e82164bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158744:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e82164c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158750:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e82164c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158756:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e82164c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158760:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fce800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478509.158763:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e82164c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158770:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e82164c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158778:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ebb024ee300) 00010000:00010000:1.0:1789478509.158780:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478509.158782:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e82164c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158786:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e82164c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158799:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158805:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158815:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158819:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfc00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478509.158822:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158828:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158835:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb024ee600) 00010000:00010000:1.0:1789478509.158837:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478509.158839:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.158845:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478509.159110:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+30:11310:x1876403945523072:12345-192.168.206.11@tcp:34:lfs.0 Request processed in 915us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478509.159119:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 102 00000100:00100000:1.0:1789478509.215022:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478509.215232:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945523328 00000100:00100000:3.0:1789478509.215241:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945523328 00000100:00100000:3.0:1789478509.215294:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 103 00000100:00100000:3.0:1789478509.215303:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+30:11313:x1876403945523328:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1789478509.215336:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478509.215365:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e82164d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b73c6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215427:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e82164db lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215452:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e82164db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215463:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e82164db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215477:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e82164e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215483:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e82164e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215489:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e82164e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215583:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e82164e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215630:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e82164e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215638:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e82164e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478509.215648:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789478509.215717:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e82164db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215725:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e82164db lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215730:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e82164db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215736:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478509.215740:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e82164db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215747:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e82164db lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215758:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:3.0:1789478509.215761:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478509.215764:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e82164db lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215771:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e82164db lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215782:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e82164e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215788:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e82164e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215794:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e82164e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215799:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478509.215807:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e82164e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215813:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e82164e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215820:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ebc02c13d00) 00010000:00010000:3.0:1789478509.215822:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478509.215824:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e82164e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215830:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e82164e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215875:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e82164d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73c6 expref: 33 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215888:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e82164e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73c6 expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.215896:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb024ee600) 00010000:00010000:3.0:1789478509.215898:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789478509.215901:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fd000, rc 0) 00000100:00100000:3.0:1789478509.215958:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+32:11313:x1876403945523328:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 647us (936us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1789478509.215966:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 103 00000100:00100000:3.0:1789478509.218563:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478509.218658:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945523456 00000100:00100000:1.0:1789478509.218666:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945523456 00000100:00100000:1.0:1789478509.218735:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 104 00000100:00100000:1.0:1789478509.218744:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+32:11313:x1876403945523456:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:1.0:1789478509.218800:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.218830:0:13638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e821648e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73aa expref: 32 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.218839:0:13638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164f7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.218879:0:13638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e821648e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73aa expref: 32 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.218893:0:13638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e821648e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73aa expref: 32 pid: 10096 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478509.218906:0:13638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13638:1876403964467584:192.168.206.11@tcp:104: 00000100:00100000:1.0:1789478509.218985:0:13638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb02647d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789478509.224024:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478509.224108:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945523712 00000100:00100000:3.0:1789478509.224117:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945523712 00000100:00100000:3.0:1789478509.224175:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 22 00000100:00100000:3.0:1789478509.224196:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+33:6629:x1876403945523712:12345-192.168.206.11@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789478509.224475:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+34:6629:x1876403945523712:12345-192.168.206.11@tcp:35:ldlm_bl.0 Request processed in 282us (459us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789478509.224484:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 22 00000100:00100000:1.0:1789478509.225649:0:13638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13638:1876403964467584:192.168.206.11@tcp:104: 00010000:00010000:1.0:1789478509.225674:0:13638:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478509.227792:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478509.228078:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945523840 00000100:00100000:0.0:1789478509.228087:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945523840 00010000:00010000:0.0:1789478509.228128:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e821648e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73aa expref: 34 pid: 10096 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478509.228166:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 66 00000100:00100000:0.0:1789478509.228174:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+34:2396:x1876403945523840:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478509.228187:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478509.228824:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e821648e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73aa expref: 34 pid: 10096 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.228838:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e821648e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73aa expref: 34 pid: 10096 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.228924:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e821648e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73aa expref: 34 pid: 10096 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.228941:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb024ee600) 00010000:00010000:0.0:1789478509.228946:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.228955:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.228962:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164f7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.229028:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478509.229083:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+33:2396:x1876403945523840:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 909us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478509.229090:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 66 00010000:00010000:3.0:1789478509.230184:0:13638:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.230197:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.230236:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.230244:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.230250:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.230256:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfc00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478509.230260:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.230267:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.230279:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb024ee600) 00010000:00010000:3.0:1789478509.230282:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789478509.230287:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.230496:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82164f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478509.230765:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+32:11313:x1876403945523456:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 12018us (12206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478509.230774:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 104 00000100:00100000:3.0:1789478509.234474:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478509.234646:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945524096 00000100:00100000:0.0:1789478509.234656:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945524096 00000100:00100000:0.0:1789478509.234719:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 23 00000100:00100000:0.0:1789478509.234730:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+32:11313:x1876403945524096:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:0.0:1789478509.234936:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+33:11313:x1876403945524096:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 208us (470us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1789478509.234955:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 23 00000100:00100000:0.0:1789478509.311576:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478509.311782:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945524352 00000100:00100000:1.0:1789478509.311791:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945524352 00000100:00100000:1.0:1789478509.311851:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 105 00000100:00100000:1.0:1789478509.311985:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+33:11324:x1876403945524352:12345-192.168.206.11@tcp:101:cat.0 00010000:00010000:1.0:1789478509.312007:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478509.312026:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e82164fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b73cd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312095:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216505 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312135:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216505 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312145:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216505 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312161:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821650c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312167:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821650c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312174:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821650c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312282:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e8216513 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312291:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e8216513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312298:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e8216513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478509.312307:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789478509.312387:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216505 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312405:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216505 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312411:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216505 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312423:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fce600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478509.312428:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216505 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312435:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216505 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312448:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:1.0:1789478509.312451:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478509.312455:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216505 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312460:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e8216505 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312473:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821650c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312479:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821650c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312485:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821650c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312490:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfc00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478509.312493:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821650c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312498:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821650c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312517:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ebb024ee300) 00010000:00010000:1.0:1789478509.312519:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478509.312522:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821650c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312528:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e821650c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312566:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e82164fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73cd expref: 36 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312579:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e8216513 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73cd expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.312586:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb024ee600) 00010000:00010000:1.0:1789478509.312588:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789478509.312590:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4a200, rc 0) 00000100:00100000:1.0:1789478509.312700:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+35:11324:x1876403945524352:12345-192.168.206.11@tcp:101:cat.0 Request processed in 720us (1131us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789478509.317134:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 105 00000100:00100000:2.0:1789478509.317531:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478509.317705:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945524608 00000100:00100000:0.0:1789478509.317714:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945524608 00000100:00100000:0.0:1789478509.317799:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:0.0:1789478509.317809:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+35:11324:x1876403945524608:12345-192.168.206.11@tcp:35:cat.0 00000100:00100000:0.0:1789478509.318166:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+36:11324:x1876403945524608:12345-192.168.206.11@tcp:35:cat.0 Request processed in 358us (636us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789478509.318175:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:0.0:1789478509.337140:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478509.337273:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945524864 00000100:00100000:1.0:1789478509.337282:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945524864 00000100:00100000:1.0:1789478509.337339:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 106 00000100:00100000:1.0:1789478509.337358:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+36:11325:x1876403945524864:12345-192.168.206.11@tcp:36:rm.0 00010000:00010000:1.0:1789478509.337423:0:10096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1789478509.337448:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82164b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73b8 expref: 36 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.337488:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e8216513 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73cd expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.337501:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd000/0x8ebaae74e82164e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73c6 expref: 34 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.337512:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82164a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73b1 expref: 33 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.337521:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb024ee600) 00010000:00010000:1.0:1789478509.337525:0:10096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789478509.337545:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216521 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.337557:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216521 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.337566:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216521 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.337580:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216528 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.337588:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216528 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.337651:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216528 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.337729:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e821652f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.337738:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e821652f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.337744:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e821652f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789478509.337932:0:10096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1789478509.337943:0:10096:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 338453348394ns, next at 339453345321ns, rc = 0 00010000:00010000:1.0:1789478509.337982:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8216536 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.337991:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8216536 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.337998:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8216536 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.338006:0:10096:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8216536 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.338012:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8216536 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.338018:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8216536 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.338031:0:10096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789478509.338047:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e821652f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.338058:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e821652f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.338064:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e821652f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.338069:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4b600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478509.338073:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e821652f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.338080:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e821652f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.338089:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb024ee600) 00010000:00010000:1.0:1789478509.338092:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789478509.338107:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e821652f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.338114:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e821652f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.338129:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216521 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.338135:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216521 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.338141:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216521 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.338146:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4a800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478509.338155:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216521 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.338162:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216521 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.338170:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:1.0:1789478509.338172:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478509.338175:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216521 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.338181:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216521 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789478509.338190:0:10096:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c4106f1 reply state 000000001b1a06cc transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216528 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.338200:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216528 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.338205:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ebb024ee300) 00010000:00010000:1.0:1789478509.338208:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789478509.338210:0:10096:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789478509.338276:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+34:11325:x1876403945524864:12345-192.168.206.11@tcp:36:rm.0 Request processed in 927us (1144us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789478509.338282:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 106 00010000:00010000:2.0:1789478509.338566:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478509.338573:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8216536 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478509.338590:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4b400 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478509.338622:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8216536 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478509.338629:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8216536 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478509.338638:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb024ee600) 00010000:00010000:2.0:1789478509.338641:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789478509.338643:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8216536 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478509.338649:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8216536 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478509.338660:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478509.338662:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478509.338663:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478509.396186:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478509.396330:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945525120 00000100:00100000:1.0:1789478509.396339:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945525120 00000100:00100000:1.0:1789478509.396410:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 107 00000100:00100000:1.0:1789478509.396420:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+34:11331:x1876403945525120:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:1.0:1789478509.396441:0:13638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478509.396471:0:13638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e821653d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b73d4 expref: -99 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.396555:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216544 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.396568:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216544 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.396579:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216544 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.396589:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e821654b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.396635:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e821654b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.396642:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e821654b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789478509.396933:0:13638:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1789478509.397059:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8216552 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.397068:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8216552 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.397075:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8216552 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.397166:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216544 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.397184:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216544 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.397190:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216544 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.397195:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4b600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478509.397199:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216544 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.397206:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216544 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.397218:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:1.0:1789478509.397222:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478509.397226:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216544 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.397232:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216544 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789478509.397244:0:13638:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da307461 reply state 00000000012401f1 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e821654b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.397254:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e821654b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.397260:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ebb024ee300) 00010000:00010000:1.0:1789478509.397263:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789478509.397265:0:13638:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789478509.397294:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e821653d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73d4 expref: 37 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.397315:0:13638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8216552 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73d4 expref: 36 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.397322:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebb024ee900) 00010000:00010000:1.0:1789478509.397325:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789478509.397327:0:13638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4aa00, rc 0) 00000100:00100000:1.0:1789478509.397394:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+37:11331:x1876403945525120:12345-192.168.206.11@tcp:101:bash.0 Request processed in 975us (1216us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1789478509.397402:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 107 00000100:00100000:1.0:1789478509.401694:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478509.401804:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945525248 00000100:00100000:3.0:1789478509.401814:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945525248 00000100:00100000:3.0:1789478509.401983:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 42 00000100:00100000:3.0:1789478509.401993:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2396:x1876403945525248:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:3.0:1789478509.402010:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478509.402028:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2fae712/0x8ebaae74e8216560 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b73db expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789478509.402051:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789478509.402067:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=338s v=(0 0) 00010000:00010000:3.0:1789478509.402072:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478509.402081:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2fae712/0x8ebaae74e8216560 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73db expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.402111:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a2fae712/0x8ebaae74e8216560 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73db expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.402124:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fd600, rc 0) 00000100:00100000:3.0:1789478509.402191:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2396:x1876403945525248:12345-192.168.206.11@tcp:101:bash.0 Request processed in 199us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478509.402198:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 42 00000100:00100000:1.0:1789478509.405004:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478509.405127:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945525376 00000100:00100000:2.0:1789478509.405136:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945525376 00000100:00100000:2.0:1789478509.405185:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 43 00000100:00100000:2.0:1789478509.405195:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:11331:x1876403945525376:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:2.0:1789478509.405209:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478509.405226:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216567 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b73e2 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478509.405252:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2fae712/0x8ebaae74e8216560 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73db expref: 9 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478509.405275:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478509.405279:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478509.405284:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216567 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73e2 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478509.405313:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a2fae712/0x8ebaae74e8216560 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73db expref: 9 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478509.405325:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a2fae712/0x8ebaae74e8216560 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73db expref: 9 pid: 8431 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478509.405338:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03676d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1876403964467712:192.168.206.11@tcp:104: 00000100:00100000:2.0:1789478509.405518:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc011ca900 going to sleep for 11 seconds 00000100:00100000:2.0:1789478509.408636:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478509.408747:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03676d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1876403964467712:192.168.206.11@tcp:104: 00010000:00010000:1.0:1789478509.408777:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216567 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73e2 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.408796:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76e00, rc 0) 00000100:00100000:1.0:1789478509.408842:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:11331:x1876403945525376:12345-192.168.206.11@tcp:101:bash.0 Request processed in 3648us (3844us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478509.408850:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 43 00000100:00100000:3.0:1789478509.409199:0:10392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945525504 00000100:00100000:3.0:1789478509.409206:0:10392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945525504 00010000:00010000:3.0:1789478509.409236:0:10392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a2fae712/0x8ebaae74e8216560 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73db expref: 9 pid: 8431 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478509.409268:0:10392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 67 00000100:00100000:3.0:1789478509.409276:0:10392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:2395:x1876403945525504:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789478509.409288:0:10392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478509.409308:0:10392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a2fae712/0x8ebaae74e8216560 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73db expref: 9 pid: 8431 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.409321:0:10392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a2fae712/0x8ebaae74e8216560 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73db expref: 9 pid: 8431 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.409342:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2fae712/0x8ebaae74e8216560 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73db expref: 9 pid: 8431 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.409370:0:10392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478509.409374:0:10392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478509.409382:0:10392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216567 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73e2 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.409553:0:10392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216567 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73e2 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.409628:0:10392:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216567 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73e2 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478509.409642:0:10392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03dfc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10392:1876403964467840:192.168.206.11@tcp:105: 00000100:00100000:3.0:1789478509.409695:0:10392:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095b1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478509.413467:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478509.413639:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945525760 00000100:00100000:2.0:1789478509.413648:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945525760 00000100:00100000:2.0:1789478509.413697:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:2.0:1789478509.413707:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+37:11331:x1876403945525760:12345-192.168.206.11@tcp:35:bash.0 00000100:00100000:2.0:1789478509.413989:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+38:11331:x1876403945525760:12345-192.168.206.11@tcp:35:bash.0 Request processed in 283us (529us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789478509.413997:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:1.0:1789478509.414302:0:10392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03dfc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10392:1876403964467840:192.168.206.11@tcp:105: 00010000:00010000:1.0:1789478509.414323:0:10392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478509.414362:0:10392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2395:x1876403945525504:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 5074us (5756us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478509.414370:0:10392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 67 00000100:00080000:0.0:1789478509.415166:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789478509.543635:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478509.543782:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945525888 00000100:00100000:1.0:1789478509.543792:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945525888 00000100:00100000:1.0:1789478509.543857:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 108 00000100:00100000:1.0:1789478509.543869:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+38:11347:x1876403945525888:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1789478509.543891:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478509.543911:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e821656e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b73e9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.543981:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216575 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.543993:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216575 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.544004:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216575 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478509.544043:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789478509.544046:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789478509.544062:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216575 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.544086:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e821656e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73e9 expref: 40 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.544116:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216575 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73e9 expref: 39 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.544124:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:1.0:1789478509.544127:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789478509.544143:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4b600, rc 0) 00000100:00100000:1.0:1789478509.544198:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+39:11347:x1876403945525888:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 331us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478509.544205:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 108 00000100:00100000:2.0:1789478509.550705:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478509.553429:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945526144 00000100:00100000:0.0:1789478509.553441:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945526144 00000100:00100000:0.0:1789478509.553493:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 109 00000100:00100000:0.0:1789478509.553504:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+39:11347:x1876403945526144:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1789478509.553521:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478509.553538:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e821657c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b73f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.553704:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e8216583 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.553718:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e8216583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.553729:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e8216583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789478509.553755:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789478509.554503:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e821657c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73f0 expref: 42 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.554524:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e8216583 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73f0 expref: 41 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.554533:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebb024ee900) 00010000:00010000:0.0:1789478509.554535:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789478509.554538:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc421ec200, rc 0) 00000100:00100000:0.0:1789478509.554701:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+41:11347:x1876403945526144:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 1197us (4003us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1789478509.554709:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 109 00000100:00100000:2.0:1789478509.561987:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478509.562042:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478509.562131:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945526400 00000100:00100000:3.0:1789478509.562140:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945526400 00000100:00100000:3.0:1789478509.562196:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 110 00000100:00100000:3.0:1789478509.562206:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+41:11347:x1876403945526400:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1789478509.562227:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478509.562245:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216591 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b73f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.562338:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216598 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.562363:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216598 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.562373:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216598 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478509.562385:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789478509.562477:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216591 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73f7 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.562507:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216598 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73f7 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.562517:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebb024ee900) 00010000:00010000:3.0:1789478509.562519:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789478509.562522:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fd400, rc 0) 00000100:00100000:3.0:1789478509.562577:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+43:11347:x1876403945526400:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 372us (598us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1789478509.562584:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 110 00000100:00100000:0.0:1789478509.565200:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945526528 00000100:00100000:0.0:1789478509.565212:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945526528 00000100:00100000:0.0:1789478509.565270:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:0.0:1789478509.565280:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+43:2395:x1876403945526528:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478509.565293:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478509.565314:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e8216583 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73f0 expref: 43 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.565329:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebb024ee900) 00010000:00010000:0.0:1789478509.565333:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478509.565391:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+42:2395:x1876403945526528:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 112us (3349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478509.565398:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:2.0:1789478509.574331:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478509.575317:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945526656 00000100:00100000:3.0:1789478509.575327:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945526656 00000100:00100000:3.0:1789478509.575398:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 44 00000100:00100000:3.0:1789478509.575408:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2395:x1876403945526656:12345-192.168.206.11@tcp:1:lfs.0 00010000:00010000:3.0:1789478509.575447:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2fae712/0x8ebaae74e82165a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.575465:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216567 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73e2 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.575474:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478509.575478:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789478509.575482:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2fae712/0x8ebaae74e82165a6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.575514:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216567 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73e2 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.575539:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216567 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73e2 expref: 8 pid: 8432 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478509.575554:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03dffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1876403964467968:192.168.206.11@tcp:104: 00000100:00100000:3.0:1789478509.575660:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095b1600 going to sleep for 11 seconds 00000100:00100000:3.0:1789478509.577924:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03dffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1876403964467968:192.168.206.11@tcp:104: 00010000:00010000:3.0:1789478509.577962:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a2fae712/0x8ebaae74e82165a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478509.580196:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478509.580282:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945526784 00000100:00100000:0.0:1789478509.580291:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945526784 00002000:00100000:0.0:1789478509.580336:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8ebc3f7e8a80 x1876403945526784/t0(0) o4->327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp:170/0 lens 504/0 e 0 to 0 dl 1789478520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789478509.580358:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ebc3f7e8a80 with x1876403945526784 ext(0->8) 00010000:00010000:0.0:1789478509.580368:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216567 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73e2 expref: 9 pid: 8432 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.580384:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216567 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73e2 expref: 9 pid: 8432 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789478509.580391:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ebc3f7e8a80 00000100:00100000:0.0:1789478509.580421:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 1 00000100:00100000:0.0:1789478509.580430:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:2395:x1876403945526784:12345-192.168.206.11@tcp:4:lfs.0 00000100:00100000:0.0:1789478509.583486:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+11:2395:x1876403945526784:12345-192.168.206.11@tcp:4:lfs.0 Request processed in 3047us (3288us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789478509.583499:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 1 00002000:00100000:0.0:1789478509.583510:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8ebc3f7e8a80 x1876403945526784/t4294967303(0) o4->327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp:170/0 lens 504/448 e 0 to 0 dl 1789478520 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789478509.583520:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ebc3f7e8a80 with x1876403945526784 ext(0->8) 00010000:00010000:0.0:1789478509.583529:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216567 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73e2 expref: 11 pid: 8432 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.583547:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216567 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73e2 expref: 11 pid: 8432 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789478509.583572:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ebc3f7e8a80 00000001:00080000:1.0:1789478509.584943:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1789478509.584964:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1789478509.589749:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478509.589843:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945526912 00000100:00100000:0.0:1789478509.589852:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945526912 00010000:00010000:0.0:1789478509.589902:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216567 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73e2 expref: 7 pid: 8432 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478509.589943:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 68 00000100:00100000:0.0:1789478509.589961:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08343850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2395:x1876403945526912:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478509.589974:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789478509.589990:0:6503:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789478509.589994:0:6503:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789478508 00002000:00010000:0.0:1789478509.589996:0:6503:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789478509 00002000:00010000:0.0:1789478509.589997:0:6503:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789478508 00002000:00010000:0.0:1789478509.589999:0:6503:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789478509.590005:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216567 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73e2 expref: 7 pid: 8432 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.590019:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216567 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73e2 expref: 7 pid: 8432 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.590039:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216567 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73e2 expref: 7 pid: 8432 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.590055:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789478509.590059:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789478509.590079:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2fae712/0x8ebaae74e82165a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.590088:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2fae712/0x8ebaae74e82165a6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.590129:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478509.590186:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08343850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2395:x1876403945526912:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 227us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478509.590194:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 68 00010000:00010000:3.0:1789478509.590871:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a2fae712/0x8ebaae74e82165a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.590884:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2fae712/0x8ebaae74e82165a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.590907:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2fae712/0x8ebaae74e82165a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.590916:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2fae712/0x8ebaae74e82165a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.590923:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2fae712/0x8ebaae74e82165a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.590945:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd600 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478509.590959:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2fae712/0x8ebaae74e82165a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.590969:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2fae712/0x8ebaae74e82165a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.590982:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2fae712/0x8ebaae74e82165a6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.590989:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2fae712/0x8ebaae74e82165a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478509.591058:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945526656:12345-192.168.206.11@tcp:1:lfs.0 Request processed in 15649us (16733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478509.591067:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 44 00000100:00100000:1.0:1789478509.595958:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478509.596189:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945527168 00000100:00100000:2.0:1789478509.596198:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945527168 00000100:00100000:2.0:1789478509.596250:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 26 00000100:00100000:2.0:1789478509.596260:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc0838f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+42:11347:x1876403945527168:12345-192.168.206.11@tcp:35:lfs.0 00000004:00010000:2.0:1789478509.596312:0:6520:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216598 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73f7 expref: 42 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789478509.596480:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1789478509.596510:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1789478509.596842:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1789478509.597210:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82165ad lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478509.597227:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8216552 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73d4 expref: 46 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478509.597235:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82165ad lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478509.597268:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8216552 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73d4 expref: 46 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478509.597282:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8216552 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73d4 expref: 46 pid: 13638 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478509.597296:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3f7e8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6520:1876403964468096:192.168.206.11@tcp:104: 00000100:00100000:2.0:1789478509.597381:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc359b6900 going to sleep for 11 seconds 00000100:00100000:2.0:1789478509.604407:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478509.604936:0:10392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945527296 00000100:00100000:3.0:1789478509.604946:0:10392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945527296 00010000:00010000:3.0:1789478509.604995:0:10392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8216552 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73d4 expref: 47 pid: 13638 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478509.605023:0:10392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 69 00000100:00100000:3.0:1789478509.605032:0:10392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+47:2396:x1876403945527296:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789478509.605045:0:10392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478509.605051:0:10392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8216552 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73d4 expref: 47 pid: 13638 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.605075:0:10392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8216552 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73d4 expref: 47 pid: 13638 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.605226:0:10392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebb024ee900) 00010000:00010000:3.0:1789478509.605233:0:10392:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82165ad lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.605242:0:10392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82165ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.605249:0:10392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82165ad lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.605268:0:10392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478509.605326:0:10392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+47:2396:x1876403945527296:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 294us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478509.605334:0:10392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 69 00010000:00010000:1.0:1789478509.606461:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8216552 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73d4 expref: 46 pid: 13638 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478509.606480:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3f7e8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6520:1876403964468096:192.168.206.11@tcp:104: 00010000:00010000:1.0:1789478509.606499:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82165ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.606508:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82165ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.606514:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82165ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789478509.606682:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1789478509.606792:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1789478509.606891:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e4df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1876403964468224:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789478509.606942:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478509.606981:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb02647a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789478509.607116:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964468224 00000100:00100000:3.0:1789478509.607122:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964468224 00000100:00100000:3.0:1789478509.607185:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789478509.607194:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1876403964468224:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789478509.607273:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1876403964468224:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 80us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478509.607280:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789478509.607310:0:6520:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:3.0:1789478509.607316:0:6520:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:3.0:1789478509.607329:0:6520:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ebc3cbc5180, transno 4294967302 00000100:00100000:3.0:1789478509.607360:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e4df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1876403964468224:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789478509.607455:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1789478509.607498:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03dffb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1876403964468352:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789478509.607526:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478509.607542:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb034bf6c0 going to sleep for 11 seconds 00000100:00080000:1.0:1789478509.607684:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789478509.607705:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964468352 00000100:00100000:1.0:1789478509.607709:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964468352 00000100:00100000:1.0:1789478509.607737:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789478509.607743:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6520:x1876403964468352:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789478509.607843:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6520:x1876403964468352:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 99us (315us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789478509.607850:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789478509.609263:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03dffb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1876403964468352:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789478509.609313:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1789478509.609376:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82165ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.609386:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82165ad lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.609393:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82165ad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.609399:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76000 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478509.609403:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82165ad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.609410:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82165ad lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.609425:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebb024ee900) 00010000:00010000:3.0:1789478509.609428:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789478509.609433:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82165ad lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.609439:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82165ad lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789478509.609543:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789478509.609632:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1789478509.609645:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338725050223ns, next at 339725047843ns, rc = 0 00000001:00080000:3.0:1789478509.609651:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1789478509.609675:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebb024ee900) 00010000:00010000:3.0:1789478509.609678:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789478509.609684:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216598 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73f7 expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478509.609778:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc0838f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+49:11347:x1876403945527168:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 13519us (13828us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1789478509.609787:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 26 00000020:00080000:3.0:1789478509.609792:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789478509.612794:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478509.613049:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945527424 00000100:00100000:0.0:1789478509.613058:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945527424 00000100:00100000:0.0:1789478509.613215:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 111 00000100:00100000:0.0:1789478509.613225:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+49:11347:x1876403945527424:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1789478509.613249:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478509.613270:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e82165b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b73fe expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.613319:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e82165b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73fe expref: 50 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.613334:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e82165b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73fe expref: 50 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.613362:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:0.0:1789478509.613366:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789478509.613369:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc421ec200, rc 0) 00000100:00100000:0.0:1789478509.613427:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+50:11347:x1876403945527424:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 203us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478509.613447:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 111 00000100:00100000:1.0:1789478509.616845:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478509.616916:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945527680 00000100:00100000:3.0:1789478509.616925:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945527680 00000100:00100000:3.0:1789478509.616979:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 27 00000100:00100000:3.0:1789478509.616989:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+50:11347:x1876403945527680:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:3.0:1789478509.617195:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+51:11347:x1876403945527680:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 207us (356us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1789478509.617203:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 27 00000100:00100000:2.0:1789478509.722734:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478509.722796:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945527808 00000100:00100000:1.0:1789478509.722805:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945527808 00000100:00100000:1.0:1789478509.722872:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 112 00000100:00100000:1.0:1789478509.722882:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+51:11357:x1876403945527808:12345-192.168.206.11@tcp:34:lfs.0 00010000:00010000:1.0:1789478509.722959:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e82165bb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.722975:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e82165bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.722985:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e82165bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.722996:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e82165c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723003:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e82165c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723008:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e82165c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723071:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a400/0x8ebaae74e82165c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723108:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a400/0x8ebaae74e82165c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723116:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a400/0x8ebaae74e82165c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789478509.723160:0:13638:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a400/0x8ebaae74e82165c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723173:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e82165bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723179:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e82165bb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723186:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e82165bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723192:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4aa00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478509.723196:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e82165bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723202:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e82165bb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723213:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:1.0:1789478509.723216:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478509.723220:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e82165bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723226:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e82165bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723250:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e82165c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723266:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e82165c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723272:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e82165c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723278:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4a000 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478509.723281:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e82165c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723287:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e82165c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723295:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ebb024ee300) 00010000:00010000:1.0:1789478509.723297:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478509.723300:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e82165c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723305:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e82165c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723315:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a400/0x8ebaae74e82165c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723320:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a400/0x8ebaae74e82165c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723325:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a400/0x8ebaae74e82165c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723336:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4a400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478509.723339:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a400/0x8ebaae74e82165c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723345:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a400/0x8ebaae74e82165c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723365:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:1.0:1789478509.723367:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478509.723371:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a400/0x8ebaae74e82165c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.723376:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a400/0x8ebaae74e82165c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478509.723448:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+51:11357:x1876403945527808:12345-192.168.206.11@tcp:34:lfs.0 Request processed in 568us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478509.723456:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 112 00000100:00100000:2.0:1789478509.777954:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478509.778146:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945528064 00000100:00100000:1.0:1789478509.778173:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945528064 00000100:00100000:1.0:1789478509.778234:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 113 00000100:00100000:1.0:1789478509.778245:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+51:11360:x1876403945528064:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1789478509.778274:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478509.778292:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a400/0x8ebaae74e82165d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7405 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.778370:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e82165d7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.778400:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e82165d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.778410:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e82165d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.778422:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e82165de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.778428:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e82165de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.778435:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e82165de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.778531:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e82165e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.778540:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e82165e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.778547:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e82165e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478509.778556:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789478509.778667:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e82165d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.778675:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e82165d7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.778681:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e82165d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.778702:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4a000 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478509.778707:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e82165d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.778714:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e82165d7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.778726:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:1.0:1789478509.778729:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478509.778733:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e82165d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.778739:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e82165d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.778751:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e82165de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.778757:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e82165de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.778762:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e82165de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.778766:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4aa00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478509.778769:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e82165de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.778774:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e82165de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.778792:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ebb024ee300) 00010000:00010000:1.0:1789478509.778795:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478509.778798:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e82165de lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.778803:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e82165de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.778846:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a400/0x8ebaae74e82165d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7405 expref: 54 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.779013:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e82165e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7405 expref: 53 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.779020:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:1.0:1789478509.779023:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789478509.779025:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4ae00, rc 0) 00000100:00100000:1.0:1789478509.779177:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+53:11360:x1876403945528064:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 933us (1237us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1789478509.779186:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 113 00000100:00100000:2.0:1789478509.787086:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478509.790006:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945528192 00000100:00100000:0.0:1789478509.790020:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945528192 00000100:00100000:0.0:1789478509.790083:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 114 00000100:00100000:0.0:1789478509.790093:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+53:11360:x1876403945528192:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:0.0:1789478509.790151:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e82165f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.790165:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e82165f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.790176:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e82165f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.790207:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e82165f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.790214:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e82165f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.790220:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e82165f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.790226:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc421edc00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478509.790229:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e82165f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.790236:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e82165f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.790248:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:0.0:1789478509.790733:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789478509.790739:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e82165f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478509.790746:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e82165f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478509.790815:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+53:11360:x1876403945528192:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 723us (3736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478509.790822:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 114 00000100:00100000:3.0:1789478509.793567:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478509.793808:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945528448 00000100:00100000:0.0:1789478509.793816:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945528448 00000100:00100000:0.0:1789478509.793870:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 28 00000100:00100000:0.0:1789478509.793879:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+53:11360:x1876403945528448:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:0.0:1789478509.794086:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+54:11360:x1876403945528448:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 207us (524us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1789478509.794094:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 28 00000100:00100000:2.0:1789478509.917305:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478509.917406:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945528704 00000100:00100000:1.0:1789478509.917415:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945528704 00000100:00100000:1.0:1789478509.917482:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 115 00000100:00100000:1.0:1789478509.917493:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+54:11370:x1876403945528704:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:1.0:1789478509.917515:0:13638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478509.917518:0:13638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789478509.917542:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216575 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73e9 expref: 54 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.917569:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:1.0:1789478509.917574:0:13638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789478509.917587:0:13638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e82165fa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b740c expref: -99 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.917734:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e8216601 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.917748:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e8216601 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.917759:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e8216601 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478509.917768:0:13638:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789478509.918015:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e82165fa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b740c expref: 56 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.918029:0:13638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e8216601 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b740c expref: 55 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478509.918037:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:1.0:1789478509.918039:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789478509.918042:0:13638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4a000, rc 0) 00000100:00100000:1.0:1789478509.918099:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+55:11370:x1876403945528704:12345-192.168.206.11@tcp:101:bash.0 Request processed in 608us (802us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1789478509.918107:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 115 00000100:00100000:1.0:1789478509.921659:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478509.922112:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945528832 00000100:00100000:3.0:1789478509.922122:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945528832 00000100:00100000:3.0:1789478509.922174:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 116 00000100:00100000:3.0:1789478509.922185:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+55:11370:x1876403945528832:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:3.0:1789478509.922206:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478509.922235:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821660f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7413 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.922280:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216616 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.922293:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216616 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.922304:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216616 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.922410:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821660f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7413 expref: 57 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.922432:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216616 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7413 expref: 56 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.922440:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:3.0:1789478509.922442:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789478509.922446:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fd600, rc 0) 00000100:00100000:3.0:1789478509.922872:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+56:11370:x1876403945528832:12345-192.168.206.11@tcp:101:bash.0 Request processed in 687us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478509.922880:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 116 00000100:00100000:0.0:1789478509.923196:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478509.924360:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945528960 00000100:00100000:3.0:1789478509.924369:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945528960 00000100:00100000:3.0:1789478509.924474:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 8 00000100:00100000:3.0:1789478509.924485:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+56:2396:x1876403945528960:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789478509.924497:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478509.924529:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e8216601 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b740c expref: 56 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.924545:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:3.0:1789478509.924549:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478509.924617:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+55:2396:x1876403945528960:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 133us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478509.924625:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 8 00000100:00100000:2.0:1789478509.928731:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478509.928819:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945529216 00000100:00100000:3.0:1789478509.928827:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945529216 00000100:00100000:3.0:1789478509.928880:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 117 00000100:00100000:3.0:1789478509.928890:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+55:11370:x1876403945529216:12345-192.168.206.11@tcp:36:bash.0 00010000:00010000:3.0:1789478509.928935:0:10096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478509.928958:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e82165e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7405 expref: 55 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.928975:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:3.0:1789478509.928990:0:10096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789478509.929137:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821661d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.929150:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821661d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.929159:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821661d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789478509.929192:0:10096:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1789478509.929209:0:10096:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c91119c2 reply state 000000000bc453df transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821661d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.929231:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821661d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478509.929237:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:3.0:1789478509.929240:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789478509.929243:0:10096:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789478509.929316:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+57:11370:x1876403945529216:12345-192.168.206.11@tcp:36:bash.0 Request processed in 426us (591us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1789478509.929323:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 117 00000020:00080000:3.0:1789478509.929328:0:10096:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789478509.931486:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478509.931579:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945529344 00000100:00100000:2.0:1789478509.931587:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945529344 00000100:00100000:2.0:1789478509.931645:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 118 00000100:00100000:2.0:1789478509.931653:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+57:11370:x1876403945529344:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:2.0:1789478509.931672:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478509.931687:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e8216624 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b741a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478509.931753:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e821662b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478509.931765:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e821662b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478509.931775:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e821662b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478509.931796:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789478509.931799:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789478509.931826:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e821662b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478509.931849:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e8216624 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b741a expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478509.931878:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e821662b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b741a expref: 58 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478509.931886:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:2.0:1789478509.931889:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789478509.931892:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76c00, rc 0) 00000100:00100000:2.0:1789478509.931936:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+58:11370:x1876403945529344:12345-192.168.206.11@tcp:101:bash.0 Request processed in 284us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478509.931994:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 118 00000100:00100000:2.0:1789478509.938269:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478509.938336:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945529600 00000100:00100000:0.0:1789478509.938343:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945529600 00000100:00100000:0.0:1789478509.938400:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 29 00000100:00100000:0.0:1789478509.938409:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+58:11370:x1876403945529600:12345-192.168.206.11@tcp:35:bash.0 00000100:00100000:0.0:1789478509.938624:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+59:11370:x1876403945529600:12345-192.168.206.11@tcp:35:bash.0 Request processed in 215us (362us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1789478509.938632:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 29 00000100:00100000:2.0:1789478510.027423:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478510.027507:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945529728 00000100:00100000:3.0:1789478510.027515:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945529728 00000100:00100000:3.0:1789478510.027589:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 119 00000100:00100000:3.0:1789478510.027635:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+59:11376:x1876403945529728:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1789478510.027658:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478510.027677:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216632 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7421 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.027737:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216639 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.027750:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216639 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.027760:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216639 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478510.027801:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789478510.027816:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789478510.027837:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216639 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.027873:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216632 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7421 expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.027890:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216639 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7421 expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.027898:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:3.0:1789478510.027900:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789478510.027903:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fca00, rc 0) 00000100:00100000:3.0:1789478510.027960:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+60:11376:x1876403945529728:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 318us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478510.027967:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 119 00000100:00080000:1.0:1789478510.029782:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789478510.033565:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478510.033953:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945529856 00000100:00100000:1.0:1789478510.033962:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945529856 00000100:00100000:1.0:1789478510.034018:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 120 00000100:00100000:1.0:1789478510.034028:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+60:11376:x1876403945529856:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1789478510.034047:0:13638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478510.034066:0:13638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8216640 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7428 expref: -99 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.034122:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216647 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.034136:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216647 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.034146:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216647 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.034157:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b000/0x8ebaae74e821664e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.034164:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b000/0x8ebaae74e821664e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.034170:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b000/0x8ebaae74e821664e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.034233:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4be00/0x8ebaae74e8216655 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.034243:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4be00/0x8ebaae74e8216655 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.034276:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4be00/0x8ebaae74e8216655 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478510.034314:0:13638:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789478510.034319:0:13638:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789478510.034336:0:13638:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4be00/0x8ebaae74e8216655 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.034357:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4be00/0x8ebaae74e8216655 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.034366:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216647 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.034373:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216647 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.034379:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216647 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.034385:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4b200 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478510.034388:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216647 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.034396:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216647 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.034412:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:1.0:1789478510.034415:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478510.034419:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216647 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.034434:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216647 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.034446:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b000/0x8ebaae74e821664e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.034451:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b000/0x8ebaae74e821664e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.034576:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b000/0x8ebaae74e821664e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.034585:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4b000 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478510.034588:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b000/0x8ebaae74e821664e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.037158:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b000/0x8ebaae74e821664e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.037177:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ebb024ee300) 00010000:00010000:1.0:1789478510.037180:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478510.037185:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b000/0x8ebaae74e821664e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.037192:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b000/0x8ebaae74e821664e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.037238:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8216640 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7428 expref: 62 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.037285:0:13638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4be00/0x8ebaae74e8216655 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7428 expref: 61 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.037293:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:1.0:1789478510.037296:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789478510.037298:0:13638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4be00, rc 0) 00000100:00100000:1.0:1789478510.037376:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+61:11376:x1876403945529856:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 3348us (3819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478510.037385:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 120 00000100:00100000:2.0:1789478510.041975:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478510.045139:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945530112 00000100:00100000:1.0:1789478510.045152:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945530112 00000100:00100000:1.0:1789478510.045275:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 121 00000100:00100000:1.0:1789478510.045287:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+61:11376:x1876403945530112:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1789478510.045306:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478510.045325:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e821665c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b742f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.045435:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216663 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.045461:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e821662b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b741a expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.045469:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4be00/0x8ebaae74e8216655 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7428 expref: 62 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.045493:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216663 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.045524:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4be00/0x8ebaae74e8216655 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7428 expref: 62 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.045538:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4be00/0x8ebaae74e8216655 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7428 expref: 62 pid: 13638 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478510.045550:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e4df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964468480:192.168.206.11@tcp:104: 00010000:00010000:1.0:1789478510.045660:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e821662b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b741a expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.045669:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e821662b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b741a expref: 62 pid: 6517 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478510.045677:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964468608:192.168.206.11@tcp:104: 00000100:00100000:1.0:1789478510.045698:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb02647000 going to sleep for 11 seconds 00000100:00100000:2.0:1789478510.050494:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478510.050651:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478510.051051:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945530240 00000100:00100000:0.0:1789478510.051060:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945530240 00010000:00010000:0.0:1789478510.051097:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4be00/0x8ebaae74e8216655 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7428 expref: 63 pid: 13638 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478510.051148:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945530368 00000100:00100000:0.0:1789478510.051152:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945530368 00010000:00010000:0.0:1789478510.051167:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e821662b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b741a expref: 64 pid: 6517 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478510.051190:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 70 00000100:00100000:0.0:1789478510.051198:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+64:2395:x1876403945530240:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478510.051210:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478510.051217:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4be00/0x8ebaae74e8216655 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7428 expref: 64 pid: 13638 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.051229:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4be00/0x8ebaae74e8216655 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7428 expref: 64 pid: 13638 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.051261:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:0.0:1789478510.051266:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216663 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.051273:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216663 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.051279:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478510.051326:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+64:2395:x1876403945530240:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 129us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478510.051333:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 70 00000100:00100000:0.0:1789478510.051361:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 71 00000100:00100000:0.0:1789478510.051367:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+63:2395:x1876403945530368:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478510.051380:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478510.051385:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e821662b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b741a expref: 63 pid: 6517 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.051394:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e821662b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b741a expref: 63 pid: 6517 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.051404:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:0.0:1789478510.051407:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216663 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.051414:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216663 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.051420:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216663 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.051434:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478510.051453:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+63:2395:x1876403945530368:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 86us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478510.051459:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 71 00010000:00010000:1.0:1789478510.052921:0:6519:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.11@tcp) returned -22 from blocking AST (req@00000000ff6810de x1876403964468480) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4be00/0x8ebaae74e8216655 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7428 expref: 62 pid: 13638 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.053041:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4be00/0x8ebaae74e8216655 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7428 expref: 62 pid: 13638 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478510.053059:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e4df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964468480:192.168.206.11@tcp:104: 00010000:00010000:0.0:1789478510.053393:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e821662b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b741a expref: 61 pid: 6517 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478510.053408:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964468608:192.168.206.11@tcp:104: 00010000:00010000:0.0:1789478510.053429:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:0.0:1789478510.053436:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216663 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.053455:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216663 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.053461:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216663 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789478510.053480:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789478510.053589:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e821665c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b742f expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.053743:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216663 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b742f expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.053751:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:0.0:1789478510.053754:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789478510.053757:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4ae00, rc 0) 00000100:00100000:0.0:1789478510.053906:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+61:11376:x1876403945530112:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 8563us (11880us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789478510.053917:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 121 00000100:00100000:2.0:1789478510.058047:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478510.058183:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945530624 00000100:00100000:3.0:1789478510.058191:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945530624 00000100:00100000:3.0:1789478510.059321:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:3.0:1789478510.059340:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+61:11376:x1876403945530624:12345-192.168.206.11@tcp:103:lfs.0 00010000:00010000:3.0:1789478510.059366:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478510.059393:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e82165b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73fe expref: 61 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.059412:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:3.0:1789478510.059415:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478510.059473:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+60:11376:x1876403945530624:12345-192.168.206.11@tcp:103:lfs.0 Request processed in 140us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478510.059497:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:2.0:1789478510.062330:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478510.062419:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945530752 00000100:00100000:3.0:1789478510.062427:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945530752 00000100:00100000:3.0:1789478510.062504:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 122 00000100:00100000:3.0:1789478510.062514:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3fca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+60:11376:x1876403945530752:12345-192.168.206.11@tcp:58:lfs.0 00010000:00010000:3.0:1789478510.062633:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216671 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.062648:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216671 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.062659:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216671 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789478510.062744:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1789478510.062820:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3fca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+60:11376:x1876403945530752:12345-192.168.206.11@tcp:58:lfs.0 Request processed in 307us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478510.062828:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 122 00000100:00100000:3.0:1789478510.066155:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478510.066753:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945530880 00000100:00100000:1.0:1789478510.066763:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945530880 00000100:00100000:1.0:1789478510.066818:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 123 00000100:00100000:1.0:1789478510.066828:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+60:11376:x1876403945530880:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1789478510.066847:0:13638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478510.066865:0:13638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4be00/0x8ebaae74e8216678 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7436 expref: -99 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.066913:0:13638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216671 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.066924:0:13638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4be00/0x8ebaae74e8216678 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7436 expref: 61 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.066942:0:13638:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216671 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.066960:0:13638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4be00/0x8ebaae74e8216678 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7436 expref: 61 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.066973:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:1.0:1789478510.066976:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789478510.066980:0:13638:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4be00/0x8ebaae74e8216678 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7436 expref: 61 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.066987:0:13638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4be00, rc 0) 00000100:00100000:1.0:1789478510.067043:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+61:11376:x1876403945530880:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 216us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478510.067071:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 123 00010000:00010000:3.0:1789478510.116756:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478510.311341:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789478510.311373:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3fca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964468736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789478510.311438:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478510.311617:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964468736 00000100:00100000:2.0:1789478510.311625:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964468736 00000100:00100000:2.0:1789478510.311677:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789478510.311686:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876403964468736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789478510.311705:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3691950080 00000100:00100000:2.0:1789478510.311756:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876403964468736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478510.311763:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789478510.311914:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3fca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964468736:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789478510.372798:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789478510.372806:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789478510.372860:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1789478510.372869:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789478510.372989:0:13792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876403964468864:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789478510.373085:0:13792:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc3c8a6300 going to sleep for 11 seconds 00000100:00100000:3.0:1789478510.377506:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478510.378293:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945531008 00000100:00100000:2.0:1789478510.378304:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945531008 00000100:00100000:2.0:1789478510.378409:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 124 00000100:00100000:2.0:1789478510.378420:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+62:11377:x1876403945531008:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789478510.378448:0:6519:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789478510.378571:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+62:11377:x1876403945531008:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 154us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478510.379322:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 124 00000100:00100000:0.0:1789478510.384562:0:13792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876403964468864:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789478510.390271:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478510.390985:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945531136 00000100:00100000:3.0:1789478510.390995:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945531136 00000100:00100000:3.0:1789478510.391071:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 125 00000100:00100000:3.0:1789478510.391082:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3fcab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+61:11377:x1876403945531136:12345-192.168.206.11@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789478510.391158:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e821667f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391174:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e821667f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391185:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e821667f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391200:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e8216686 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391208:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e8216686 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391214:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e8216686 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391235:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e821668d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391243:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e821668d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391249:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e821668d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478510.391289:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789478510.391293:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789478510.391304:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e821668d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391320:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e821667f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391327:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e821667f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391334:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e821667f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391339:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fdc00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478510.391355:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e821667f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391363:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e821667f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391374:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ebc40e36e00) 00010000:00010000:3.0:1789478510.391377:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478510.391382:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e821667f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391388:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e821667f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391401:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e8216686 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391408:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e8216686 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391413:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e8216686 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391423:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fc400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478510.391426:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e8216686 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391432:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e8216686 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391441:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8ebc02c13d00) 00010000:00010000:3.0:1789478510.391443:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478510.391446:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e8216686 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391452:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e8216686 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391465:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e821668d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391471:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e821668d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391476:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e821668d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391481:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fce00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478510.391483:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e821668d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391489:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e821668d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391507:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:3.0:1789478510.391509:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478510.391513:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e821668d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.391519:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e821668d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478510.393526:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3fcab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+61:11377:x1876403945531136:12345-192.168.206.11@tcp:34:lhsmtool_posix.0 Request processed in 2437us (3254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478510.393538:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 125 00000100:00100000:1.0:1789478510.400432:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478510.400725:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945531392 00000100:00100000:2.0:1789478510.400734:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945531392 00000100:00100000:2.0:1789478510.400788:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 126 00000100:00100000:2.0:1789478510.400799:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+61:11377:x1876403945531392:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789478510.400818:0:13638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478510.400837:0:13638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216694 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b743d expref: -99 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.400931:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e821669b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.400946:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e821669b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.400957:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e821669b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478510.400968:0:13638:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789478510.401036:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e821669b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.401061:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e821669b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.401067:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e821669b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.401073:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76e00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478510.401077:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e821669b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.401084:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e821669b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.401095:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:2.0:1789478510.401098:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789478510.401103:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e821669b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.401110:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e821669b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.401155:0:13638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216694 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b743d expref: 63 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.401166:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ebc40e36e00) 00010000:00010000:2.0:1789478510.401168:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789478510.401171:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216694 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b743d expref: 63 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.401180:0:13638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76800, rc 0) 00000100:00100000:2.0:1789478510.401389:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+62:11377:x1876403945531392:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 590us (963us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1789478510.401397:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 126 00000100:00100000:1.0:1789478510.414924:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478510.415351:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945531520 00000100:00100000:2.0:1789478510.415361:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945531520 00000100:00100000:2.0:1789478510.415425:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 127 00000100:00100000:2.0:1789478510.415435:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+62:11377:x1876403945531520:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789478510.415484:0:6519:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789478510.415590:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+62:11377:x1876403945531520:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 156us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478510.415634:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 127 00000100:00100000:1.0:1789478510.431018:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478510.431179:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945531776 00000100:00100000:0.0:1789478510.431199:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945531776 00000100:00100000:0.0:1789478510.431251:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 128 00000100:00100000:0.0:1789478510.431260:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+62:11377:x1876403945531776:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789478510.431277:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478510.431280:0:10096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789478510.431316:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216639 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7421 expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.431335:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:0.0:1789478510.431339:0:10096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789478510.431360:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e82166a9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7444 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789478510.432327:0:10096:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1789478510.437526:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e82166b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.437547:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e82166b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.437560:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e82166b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.437692:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e82166a9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7444 expref: 64 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.437713:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e82166b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7444 expref: 63 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.437739:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ebc40e80900) 00010000:00010000:0.0:1789478510.437742:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789478510.437745:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc421ec200, rc 0) 00000100:00100000:0.0:1789478510.438000:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+63:11377:x1876403945531776:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 6740us (6988us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1789478510.438010:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 128 00000100:00100000:1.0:1789478510.441229:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478510.444833:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945532032 00000100:00100000:3.0:1789478510.444847:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945532032 00000100:00100000:2.0:1789478510.447154:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 129 00000100:00100000:2.0:1789478510.447265:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+63:11377:x1876403945532032:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789478510.447319:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478510.447358:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e82166b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7444 expref: 63 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.447377:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ebc40e80900) 00010000:00010000:2.0:1789478510.447387:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789478510.447405:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e82166be lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.447417:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e82166be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.447426:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e82166be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.447455:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82166c5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x226a5f4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.447463:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82166c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x226a5f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.447469:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82166c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x226a5f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.447513:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e82166be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.447520:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e82166be lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.447532:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e82166be lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.447538:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478510.447542:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e82166be lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.447549:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e82166be lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.447557:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:2.0:1789478510.447560:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478510.447563:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e82166be lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.447569:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e82166be lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.447684:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82166c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x226a5f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.447690:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82166c5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x226a5f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.447695:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82166c5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x226a5f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.447700:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76e00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478510.447703:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82166c5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x226a5f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.447708:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82166c5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x226a5f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.447716:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x226a5f4f (ffff8ebc1046f400) 00010000:00010000:2.0:1789478510.447717:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478510.447720:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82166c5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x226a5f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.447726:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82166c5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x226a5f4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478510.448263:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+62:11377:x1876403945532032:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 1096us (7039us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789478510.448271:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 129 00000100:00100000:0.0:1789478510.452768:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478510.452860:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945532160 00000100:00100000:3.0:1789478510.452870:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945532160 00000100:00100000:3.0:1789478510.452933:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 130 00000100:00100000:3.0:1789478510.452951:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+62:11377:x1876403945532160:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789478510.452969:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478510.453001:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82166cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b744b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.453034:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e82166d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.453047:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e82166d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.453058:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e82166d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.453183:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82166cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b744b expref: 64 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.453213:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e82166d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b744b expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.453221:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ebc02c13d00) 00010000:00010000:3.0:1789478510.453224:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789478510.453227:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fc400, rc 0) 00000100:00100000:3.0:1789478510.453284:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+63:11377:x1876403945532160:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 341us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478510.453291:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 130 00000100:00100000:2.0:1789478510.462084:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478510.462434:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945532416 00000100:00100000:0.0:1789478510.462444:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945532416 00000100:00100000:0.0:1789478510.462500:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 131 00000100:00100000:0.0:1789478510.462510:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3fcaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+63:11377:x1876403945532416:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789478510.462580:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e82166da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.462620:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e82166da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.462632:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e82166da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789478510.462773:0:10096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1789478510.462782:0:10096:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 339578188168ns, next at 340578185234ns, rc = 0 00000004:00010000:0.0:1789478510.462822:0:10096:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007fae081d reply state 000000002eba39ee transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e82166da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.462835:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e82166da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.462870:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ebc02c13d00) 00010000:00010000:0.0:1789478510.462873:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789478510.462877:0:10096:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789478510.462972:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3fcaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+65:11377:x1876403945532416:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 463us (895us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1789478510.462979:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 131 00000100:00100000:1.0:1789478510.466181:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478510.467364:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945532544 00000100:00100000:2.0:1789478510.467375:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945532544 00000100:00100000:2.0:1789478510.467977:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 132 00000100:00100000:2.0:1789478510.467988:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+65:11377:x1876403945532544:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789478510.468020:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478510.468039:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82166e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7452 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.468090:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82166e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7452 expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.468106:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82166e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7452 expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.468123:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ebc02c13d00) 00010000:00010000:2.0:1789478510.468126:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789478510.468129:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76e00, rc 0) 00000100:00100000:2.0:1789478510.468193:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+66:11377:x1876403945532544:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 207us (2019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478510.468209:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 132 00000100:00100000:1.0:1789478510.471776:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478510.471941:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945532672 00000100:00100000:3.0:1789478510.471959:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945532672 00000100:00100000:3.0:1789478510.472010:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 45 00000100:00100000:3.0:1789478510.472020:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2396:x1876403945532672:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789478510.472190:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:2396:x1876403945532672:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 Request processed in 172us (421us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789478510.472204:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 45 00000100:00100000:1.0:1789478510.475507:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478510.475798:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945532928 00000100:00100000:0.0:1789478510.475807:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945532928 00000100:00100000:0.0:1789478510.476425:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 30 00000100:00100000:0.0:1789478510.476437:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+66:11377:x1876403945532928:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789478510.476661:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+67:11377:x1876403945532928:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 227us (1161us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1789478510.477642:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 30 00000100:00100000:1.0:1789478510.480089:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478510.484537:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945533184 00000100:00100000:2.0:1789478510.484550:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945533184 00000100:00100000:2.0:1789478510.484692:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 133 00000100:00100000:2.0:1789478510.484703:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+67:11377:x1876403945533184:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789478510.484807:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+67:11377:x1876403945533184:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 106us (4725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478510.484820:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 133 00000100:00100000:1.0:1789478510.488050:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478510.488726:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945533312 00000100:00100000:0.0:1789478510.488735:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945533312 00000100:00100000:0.0:1789478510.488824:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 134 00000100:00100000:0.0:1789478510.488834:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+67:11377:x1876403945533312:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789478510.488864:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478510.488882:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e82166e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7459 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.489101:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ede00/0x8ebaae74e82166ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.489116:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ede00/0x8ebaae74e82166ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.489144:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ede00/0x8ebaae74e82166ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789478510.489303:0:10096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789478510.489323:0:10096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ede00/0x8ebaae74e82166ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.489362:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e82166e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7459 expref: 69 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.489379:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ede00/0x8ebaae74e82166ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7459 expref: 68 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.489452:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ebc02c13d00) 00010000:00010000:0.0:1789478510.489456:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789478510.489459:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc421ede00, rc 0) 00000100:00100000:0.0:1789478510.489517:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+68:11377:x1876403945533312:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 684us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478510.489524:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 134 00000100:00100000:1.0:1789478510.493822:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478510.493908:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945533440 00000100:00100000:0.0:1789478510.493918:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945533440 00000100:00100000:0.0:1789478510.493969:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 46 00000100:00100000:0.0:1789478510.493979:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:2395:x1876403945533440:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789478510.494006:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478510.494025:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a368f21b/0x8ebaae74e82166f6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7460 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789478510.494077:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9466e, blocks: 0x0 00010000:00010000:0.0:1789478510.494096:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1789478510.494100:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478510.494109:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a368f21b/0x8ebaae74e82166f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7460 expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.494125:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a368f21b/0x8ebaae74e82166f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7460 expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.494139:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc421eca00, rc 0) 00000100:00100000:0.0:1789478510.494191:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+10:2395:x1876403945533440:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 213us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478510.494206:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 46 00000100:00100000:0.0:1789478510.500076:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478510.500232:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945533696 00000100:00100000:2.0:1789478510.500254:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945533696 00000100:00100000:2.0:1789478510.500312:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 135 00000100:00100000:2.0:1789478510.500322:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+68:11377:x1876403945533696:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789478510.500447:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+68:11377:x1876403945533696:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 126us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478510.500455:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 135 00000100:00100000:1.0:1789478510.507578:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478510.507920:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945533824 00000100:00100000:3.0:1789478510.508098:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945533824 00000100:00100000:2.0:1789478510.508323:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 47 00000100:00100000:2.0:1789478510.508333:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+10:11377:x1876403945533824:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789478510.508359:0:8829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478510.508376:0:8829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1600edc/0x8ebaae74e82166fd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7467 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.508415:0:8829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a368f21b/0x8ebaae74e82166f6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7460 expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.508425:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478510.508429:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478510.508434:0:8829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1600edc/0x8ebaae74e82166fd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7467 expref: 11 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.508466:0:8829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a368f21b/0x8ebaae74e82166f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7460 expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.508478:0:8829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a368f21b/0x8ebaae74e82166f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7460 expref: 11 pid: 8430 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478510.508511:0:8829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3fcaa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8829:1876403964468992:192.168.206.11@tcp:104: 00000100:00100000:2.0:1789478510.508673:0:8829:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc359b60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478510.515273:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478510.515583:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945533952 00000100:00100000:0.0:1789478510.515619:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945533952 00010000:00010000:0.0:1789478510.515656:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a368f21b/0x8ebaae74e82166f6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7460 expref: 12 pid: 8430 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478510.515692:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 72 00000100:00100000:0.0:1789478510.515702:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+12:2395:x1876403945533952:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478510.515716:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478510.515734:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a368f21b/0x8ebaae74e82166f6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7460 expref: 12 pid: 8430 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.515763:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a368f21b/0x8ebaae74e82166f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7460 expref: 12 pid: 8430 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.515786:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478510.515791:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478510.515799:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1600edc/0x8ebaae74e82166fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7467 expref: 12 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.515808:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1600edc/0x8ebaae74e82166fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7467 expref: 12 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.515843:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d1600edc/0x8ebaae74e82166fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7467 expref: 12 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478510.515867:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c6b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6503:1876403964469120:192.168.206.11@tcp:105: 00000100:00100000:0.0:1789478510.515933:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc3c8a6180 going to sleep for 11 seconds 00000100:00100000:1.0:1789478510.518647:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c6b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6503:1876403964469120:192.168.206.11@tcp:105: 00010000:00010000:1.0:1789478510.518671:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478510.518721:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+12:2395:x1876403945533952:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 3019us (3455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478510.518731:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 72 00010000:00010000:2.0:1789478510.519880:0:8829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a368f21b/0x8ebaae74e82166f6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7460 expref: 11 pid: 8430 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478510.519901:0:8829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3fcaa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8829:1876403964468992:192.168.206.11@tcp:104: 00010000:00010000:2.0:1789478510.519923:0:8829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d1600edc/0x8ebaae74e82166fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7467 expref: 10 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.519936:0:8829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76800, rc 0) 00000100:00100000:2.0:1789478510.520209:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+10:11377:x1876403945533824:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 11876us (12639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478510.520217:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 47 00000100:00100000:0.0:1789478510.526150:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478510.526359:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945534080 00000100:00100000:1.0:1789478510.526369:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945534080 00002000:00100000:1.0:1789478510.526484:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8ebb03c69880 x1876403945534080/t0(0) o4->327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp:171/0 lens 504/0 e 0 to 0 dl 1789478521 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789478510.526494:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ebb03c69880 with x1876403945534080 ext(0->12) 00002000:00010000:1.0:1789478510.526501:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ebb03c69880 00000100:00100000:1.0:1789478510.526532:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 2 00000100:00100000:1.0:1789478510.526542:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+10:2395:x1876403945534080:12345-192.168.206.11@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789478510.528626:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+12:2395:x1876403945534080:12345-192.168.206.11@tcp:4:lhsmtool_posix.0 Request processed in 1847us (2245us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789478510.528639:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 2 00002000:00100000:1.0:1789478510.528651:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8ebb03c69880 x1876403945534080/t4294967309(0) o4->327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp:171/0 lens 504/448 e 0 to 0 dl 1789478521 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789478510.528659:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ebb03c69880 with x1876403945534080 ext(0->12) 00002000:00010000:1.0:1789478510.528664:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ebb03c69880 00000100:00100000:1.0:1789478510.532828:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478510.535514:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945534208 00000100:00100000:2.0:1789478510.535527:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945534208 00000100:00100000:2.0:1789478510.535677:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 136 00000100:00100000:2.0:1789478510.535688:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+68:11377:x1876403945534208:12345-192.168.206.11@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789478510.538511:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:3.0:1789478510.538524:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:3.0:1789478510.538565:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1789478510.538581:0:6496:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ebc095b1f00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1789478510.538616:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ebc02b97300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ebc095b1600 00000020:00080000:3.0:1789478510.538620:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ebc02b97f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ebb03d3c400 00000004:00080000:3.0:1789478510.538648:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789478510.538684:0:6496:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ebc05488900 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1789478510.538688:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ebc02b97800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ebc08f46600 00000020:00080000:3.0:1789478510.538690:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ebc02b97700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ebc34ea8a00 00000020:00080000:3.0:1789478510.538780:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1789478510.538894:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789478510.538913:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03dfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964469248:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789478510.539157:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3fcaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964469376:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789478510.539251:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216402 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539262:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216402 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539268:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216402 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539273:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfe00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478510.539277:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216402 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539284:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216402 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539299:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ebb024eed00) 00010000:00010000:1.0:1789478510.539302:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478510.539307:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216402 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539325:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e8216402 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539361:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82164aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539367:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82164aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539372:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82164aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539377:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcf600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478510.539380:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82164aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539386:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82164aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539404:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ebb024ee600) 00010000:00010000:1.0:1789478510.539406:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478510.539409:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82164aa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539414:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82164aa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539427:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216528 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539432:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216528 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539444:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216528 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539450:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4a600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478510.539453:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216528 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539459:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216528 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539468:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ebb024ee300) 00010000:00010000:1.0:1789478510.539470:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478510.539472:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216528 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539477:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216528 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539488:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e821654b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539494:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e821654b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539499:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e821654b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539503:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4a200 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478510.539506:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e821654b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539520:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e821654b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539529:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ebb024ee300) 00010000:00010000:1.0:1789478510.539531:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478510.539534:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e821654b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539538:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e821654b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539551:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821661d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539557:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821661d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539562:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821661d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539566:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478510.539569:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821661d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539574:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821661d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539580:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:1.0:1789478510.539581:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478510.539583:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821661d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539630:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821661d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539645:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e82166da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539652:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e82166da lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539657:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e82166da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539662:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc421ed600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478510.539665:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e82166da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539671:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e82166da lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539680:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ebc02c13d00) 00010000:00010000:1.0:1789478510.539682:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789478510.539686:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e82166da lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.539690:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e82166da lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478510.539712:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3fca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964469504:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789478510.540250:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478510.540300:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964469376 00000100:00100000:2.0:1789478510.540307:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964469376 00000100:00100000:2.0:1789478510.540366:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789478510.540375:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3fca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876403964469376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789478510.540470:0:8430:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:2.0:1789478510.540492:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dafac8af/0x8ebaae74e8216704 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.540511:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004cbc0e46/0x8ebaae74e82164b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73bf expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.540520:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789478510.540524:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789478510.540529:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dafac8af/0x8ebaae74e8216704 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.540556:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004cbc0e46/0x8ebaae74e82164b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73bf expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.540570:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004cbc0e46/0x8ebaae74e82164b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73bf expref: 11 pid: 8432 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478510.540583:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3fca8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1876403964469632:192.168.206.11@tcp:104: 00000100:00100000:2.0:1789478510.540660:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc359b60c0 going to sleep for 11 seconds 00000100:00080000:2.0:1789478510.541501:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789478510.541858:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478510.542152:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478510.542214:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+16:11377:x1876403945534208:12345-192.168.206.11@tcp:44:lhsmtool_posix.0 Request processed in 6524us (9389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478510.542225:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 136 00000100:00100000:3.0:1789478510.544014:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478510.547417:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478510.547648:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964469248 00000100:00100000:1.0:1789478510.547680:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964469248 00000100:00100000:1.0:1789478510.547716:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964469504 00000100:00100000:1.0:1789478510.547719:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964469504 00000100:00100000:1.0:1789478510.547731:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945534336 00000100:00100000:1.0:1789478510.547734:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945534336 00000100:00100000:1.0:1789478510.547750:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789478510.547759:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876403964469248:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789478510.547786:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:1.0:1789478510.547815:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa9466c, atime: 0x6aa9466d, ctime: 0x6aa9466c, blocks: 0x8 00010000:00010000:1.0:1789478510.547823:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9211d06/0x8ebaae74e821670b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.547838:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=339s v=(0 0) 00010000:00010000:1.0:1789478510.547843:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478510.547850:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9211d06/0x8ebaae74e821670b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.547866:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9211d06/0x8ebaae74e821670b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.547875:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9211d06/0x8ebaae74e821670b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.547883:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9211d06/0x8ebaae74e821670b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.547897:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789478510.548052:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1876403964469248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 293us (6205us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789478510.548066:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789478510.548083:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789478510.548089:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cb76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3648:x1876403964469504:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789478510.548155:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789478510.548159:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789478510 00002000:00010000:1.0:1789478510.548162:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789478510.548164:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789478510 -> 1789478510 00002000:00010000:1.0:1789478510.548167:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789478510.548198:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cb76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3648:x1876403964469504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (6046us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789478510.548205:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789478510.548218:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:1.0:1789478510.548225:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+12:2396:x1876403945534336:12345-192.168.206.11@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1789478510.548284:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ebc3fca8e00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789478510.548290:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3fca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964469504:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1789478510.548333:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ebb03dfd180/2, rc 0, transno 4294967305 00000100:00100000:1.0:1789478510.548338:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03dfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964469248:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789478510.550143:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789478510.550155:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9211d06/0x8ebaae74e821670b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.550167:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4a200 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478510.550171:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9211d06/0x8ebaae74e821670b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.550182:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9211d06/0x8ebaae74e821670b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.550211:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9211d06/0x8ebaae74e821670b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.550238:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9211d06/0x8ebaae74e821670b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.550261:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478510.550263:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478510.550265:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478510.551356:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3fca8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1876403964469632:192.168.206.11@tcp:104: 00010000:00010000:3.0:1789478510.551382:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dafac8af/0x8ebaae74e8216704 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478510.551797:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945534464 00000100:00100000:2.0:1789478510.551804:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945534464 00010000:00010000:2.0:1789478510.551837:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004cbc0e46/0x8ebaae74e82164b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73bf expref: 13 pid: 8432 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478510.551878:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 73 00000100:00100000:2.0:1789478510.551898:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08343c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+13:2396:x1876403945534464:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789478510.551911:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478510.551918:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004cbc0e46/0x8ebaae74e82164b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73bf expref: 13 pid: 8432 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.551930:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004cbc0e46/0x8ebaae74e82164b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73bf expref: 13 pid: 8432 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.551949:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cbc0e46/0x8ebaae74e82164b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b73bf expref: 13 pid: 8432 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.551962:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789478510.551967:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789478510.551972:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dafac8af/0x8ebaae74e8216704 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.551981:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dafac8af/0x8ebaae74e8216704 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.552010:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789478510.552076:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dafac8af/0x8ebaae74e8216704 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.552085:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dafac8af/0x8ebaae74e8216704 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.552094:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dafac8af/0x8ebaae74e8216704 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.552100:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dafac8af/0x8ebaae74e8216704 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.552117:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789478510.552224:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08343c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+12:2396:x1876403945534464:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 327us (4813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478510.552231:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 73 00010000:00010000:2.0:1789478510.552274:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789478510.552277:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3fca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3647:x1876403964469376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11903us (12028us total) trans 4294967311 rc 0/0 00010000:00010000:2.0:1789478510.552279:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dafac8af/0x8ebaae74e8216704 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478510.552304:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:2.0:1789478510.552306:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76600 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478510.552310:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dafac8af/0x8ebaae74e8216704 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.552318:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dafac8af/0x8ebaae74e8216704 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.552329:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dafac8af/0x8ebaae74e8216704 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.552336:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dafac8af/0x8ebaae74e8216704 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.552362:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478510.552364:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478510.552366:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789478510.552390:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ebc3fcaa300/2, rc 0, transno 4294967311 00000100:00100000:2.0:1789478510.552397:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3fcaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964469376:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1789478510.556919:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1789478510.556935:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:1.0:1789478510.558544:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2396:x1876403945534336:12345-192.168.206.11@tcp:16:lhsmtool_posix.0 Request processed in 10060us (14277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478510.558558:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:3.0:1789478510.562391:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478510.563517:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945534720 00000100:00100000:0.0:1789478510.563527:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945534720 00000100:00100000:0.0:1789478510.563643:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 137 00000100:00100000:0.0:1789478510.563662:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+16:11377:x1876403945534720:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789478510.563725:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478510.563750:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ede00/0x8ebaae74e82166ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7459 expref: 16 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.563768:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ebc02c13d00) 00010000:00010000:0.0:1789478510.563772:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789478510.563798:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e8216712 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.563823:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e8216712 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.563833:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e8216712 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789478510.563937:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f1ce9b6 reply state 00000000f55b0b14 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e8216712 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.563958:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e8216712 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.563964:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ebc02c13d00) 00010000:00010000:0.0:1789478510.563967:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789478510.563969:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789478510.564062:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+17:11377:x1876403945534720:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 409us (1678us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1789478510.564069:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 137 00000100:00100000:3.0:1789478510.566070:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478510.566374:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945534848 00000100:00100000:1.0:1789478510.566383:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945534848 00000100:00100000:1.0:1789478510.566428:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:1.0:1789478510.566438:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0359a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2395:x1876403945534848:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789478510.566575:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789478510.566579:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1789478510 -> 1789478509 00002000:00010000:1.0:1789478510.566581:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789478509 00002000:00010000:1.0:1789478510.566582:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789478510 -> 1789478509 00002000:00010000:1.0:1789478510.566584:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789478510.566644:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0359a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2395:x1876403945534848:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 Request processed in 207us (580us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789478510.566652:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:1.0:1789478510.568763:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478510.571388:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945535104 00000100:00100000:2.0:1789478510.571400:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945535104 00000100:00100000:2.0:1789478510.571552:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 138 00000100:00100000:2.0:1789478510.571563:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+17:11377:x1876403945535104:12345-192.168.206.11@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789478510.571645:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216719 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.571686:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e82166d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b744b expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.571695:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216719 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.571728:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e82166d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b744b expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.571742:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e82166d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b744b expref: 17 pid: 6518 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478510.571756:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3fcaa680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1876403964469760:192.168.206.11@tcp:104: 00000100:00100000:2.0:1789478510.571900:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc359b6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789478510.575632:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478510.575816:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945535232 00000100:00100000:0.0:1789478510.575825:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945535232 00010000:00010000:0.0:1789478510.575858:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e82166d3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b744b expref: 18 pid: 6518 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478510.575910:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 74 00000100:00100000:0.0:1789478510.575920:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03598e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:2395:x1876403945535232:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478510.575933:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478510.575940:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e82166d3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b744b expref: 18 pid: 6518 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.575952:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e82166d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b744b expref: 18 pid: 6518 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.575982:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ebc02c13d00) 00010000:00010000:0.0:1789478510.575987:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216719 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.576001:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216719 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.576008:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216719 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.576025:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478510.576064:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03598e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:2395:x1876403945535232:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 145us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478510.576071:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 74 00010000:00010000:2.0:1789478510.577330:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e82166d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b744b expref: 17 pid: 6518 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478510.577361:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3fcaa680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1876403964469760:192.168.206.11@tcp:104: 00010000:00010000:2.0:1789478510.577382:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216719 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.577390:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216719 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.577395:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216719 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.577492:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216719 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.577511:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216719 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.577518:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216719 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.577523:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478510.577527:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216719 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.577534:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216719 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.577546:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ebc02c13d00) 00010000:00010000:2.0:1789478510.577549:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789478510.577553:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216719 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.577559:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216719 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478510.577747:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+16:11377:x1876403945535104:12345-192.168.206.11@tcp:55:lhsmtool_posix.0 Request processed in 6184us (8990us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789478510.577756:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 138 00000100:00100000:3.0:1789478510.580479:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478510.580669:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945535360 00000100:00100000:0.0:1789478510.580679:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945535360 00000100:00100000:0.0:1789478510.580788:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 53 00000100:00100000:0.0:1789478510.580800:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2397:x1876403945535360:12345-192.168.206.11@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789478510.580889:0:8829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c3159528/0x8ebaae74e8216720 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.580909:0:8829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1600edc/0x8ebaae74e82166fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7467 expref: 7 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.580917:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478510.580921:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789478510.580926:0:8829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3159528/0x8ebaae74e8216720 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.580971:0:8829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d1600edc/0x8ebaae74e82166fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7467 expref: 7 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.580985:0:8829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d1600edc/0x8ebaae74e82166fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7467 expref: 7 pid: 8829 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478510.580999:0:8829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8829:1876403964469888:192.168.206.11@tcp:104: 00000100:00100000:0.0:1789478510.581075:0:8829:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc3c8a6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478510.585162:0:8829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8829:1876403964469888:192.168.206.11@tcp:104: 00010000:00010000:0.0:1789478510.585192:0:8829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c3159528/0x8ebaae74e8216720 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478510.585300:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478510.586412:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945535488 00000100:00100000:0.0:1789478510.586422:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945535488 00010000:00010000:0.0:1789478510.586463:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d1600edc/0x8ebaae74e82166fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7467 expref: 8 pid: 8829 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478510.586522:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 75 00000100:00100000:0.0:1789478510.586532:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2395:x1876403945535488:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478510.586546:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478510.586566:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d1600edc/0x8ebaae74e82166fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7467 expref: 8 pid: 8829 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.586579:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d1600edc/0x8ebaae74e82166fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7467 expref: 8 pid: 8829 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.586635:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1600edc/0x8ebaae74e82166fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7467 expref: 8 pid: 8829 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.586652:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789478510.586656:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789478510.586661:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3159528/0x8ebaae74e8216720 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.586670:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3159528/0x8ebaae74e8216720 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.586696:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478510.586747:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2395:x1876403945535488:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 216us (1940us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478510.586754:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 75 00010000:00010000:3.0:1789478510.589164:0:8829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c3159528/0x8ebaae74e8216720 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.589182:0:8829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3159528/0x8ebaae74e8216720 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.589209:0:8829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c3159528/0x8ebaae74e8216720 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.589218:0:8829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3159528/0x8ebaae74e8216720 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.589237:0:8829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3159528/0x8ebaae74e8216720 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.589245:0:8829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc421ede00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478510.589249:0:8829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3159528/0x8ebaae74e8216720 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.589258:0:8829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3159528/0x8ebaae74e8216720 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.589290:0:8829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3159528/0x8ebaae74e8216720 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.589298:0:8829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3159528/0x8ebaae74e8216720 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478510.589400:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2397:x1876403945535360:12345-192.168.206.11@tcp:1:lhsmtool_posix.0 Request processed in 8599us (9172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478510.589409:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 53 00000100:00100000:0.0:1789478510.594381:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478510.594472:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945535744 00000100:00100000:2.0:1789478510.594481:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945535744 00000100:00100000:2.0:1789478510.594566:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 139 00000100:00100000:2.0:1789478510.594577:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+16:11377:x1876403945535744:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789478510.594685:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216727 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.594714:0:13638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216616 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7413 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.594723:0:13638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216727 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.594756:0:13638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216616 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7413 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.594769:0:13638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216616 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7413 expref: 16 pid: 6518 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478510.594783:0:13638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3fcaa680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13638:1876403964470016:192.168.206.11@tcp:104: 00000100:00100000:2.0:1789478510.595148:0:13638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc359b6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789478510.598913:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478510.598998:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945535872 00000100:00100000:1.0:1789478510.599007:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945535872 00010000:00010000:1.0:1789478510.599041:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216616 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7413 expref: 17 pid: 6518 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478510.599082:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 76 00000100:00100000:1.0:1789478510.599091:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3fca8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+17:2396:x1876403945535872:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789478510.599115:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478510.599122:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216616 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7413 expref: 17 pid: 6518 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.599135:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216616 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7413 expref: 17 pid: 6518 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.599155:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:1.0:1789478510.599161:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4be00/0x8ebaae74e8216678 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7436 expref: 17 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.599184:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216727 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.599192:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216727 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.599199:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216727 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.599215:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478510.599267:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3fca8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+17:2396:x1876403945535872:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 176us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478510.599275:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 76 00010000:00010000:0.0:1789478510.600907:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216616 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7413 expref: 16 pid: 6518 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478510.600929:0:13638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3fcaa680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13638:1876403964470016:192.168.206.11@tcp:104: 00010000:00010000:0.0:1789478510.600962:0:13638:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216727 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.600972:0:13638:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216727 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.600977:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216727 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.601163:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e821672e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.601175:0:13638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82166e1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7452 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.601183:0:13638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e821672e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.601213:0:13638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82166e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7452 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.601228:0:13638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82166e1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7452 expref: 16 pid: 6517 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478510.601242:0:13638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c68e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13638:1876403964470144:192.168.206.11@tcp:104: 00000100:00100000:0.0:1789478510.601317:0:13638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc3c8a69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478510.604831:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478510.604899:0:10392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945536000 00000100:00100000:3.0:1789478510.604907:0:10392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945536000 00010000:00010000:3.0:1789478510.604956:0:10392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82166e1 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7452 expref: 17 pid: 6517 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478510.604997:0:10392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 77 00000100:00100000:3.0:1789478510.605008:0:10392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3fcabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+17:2395:x1876403945536000:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789478510.605021:0:10392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478510.605027:0:10392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82166e1 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7452 expref: 17 pid: 6517 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.605040:0:10392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82166e1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7452 expref: 17 pid: 6517 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.605062:0:10392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ebc02c13d00) 00010000:00010000:3.0:1789478510.605067:0:10392:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e821672e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.605088:0:10392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e821672e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.605104:0:10392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e821672e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.605123:0:10392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478510.605176:0:10392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3fcabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+17:2395:x1876403945536000:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 170us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478510.605184:0:10392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 77 00010000:00010000:0.0:1789478510.606107:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82166e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7452 expref: 16 pid: 6517 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478510.606125:0:13638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c68e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13638:1876403964470144:192.168.206.11@tcp:104: 00010000:00010000:0.0:1789478510.606144:0:13638:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e821672e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.606155:0:13638:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e821672e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.606161:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e821672e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789478510.606255:0:13638:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1789478510.606374:0:13638:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1789478510.606408:0:13638:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1789478510.606473:0:13638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c68e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13638:1876403964470272:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789478510.606518:0:13638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478510.606539:0:13638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc3c8a6180 going to sleep for 11 seconds 00000100:00100000:1.0:1789478510.607110:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964470272 00000100:00100000:1.0:1789478510.607117:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964470272 00000100:00100000:1.0:1789478510.607158:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789478510.607167:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13638:x1876403964470272:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789478510.607254:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13638:x1876403964470272:12345-0@lo:1000:mdt00_004.0 Request processed in 89us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478510.607261:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789478510.608652:0:13638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1789478510.608661:0:13638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:0.0:1789478510.608682:0:13638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ebc3fca8e00, transno 4294967310 00000004:00080000:0.0:1789478510.608700:0:13638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ebc3fcaa300, transno 4294967311 00000100:00100000:0.0:1789478510.608708:0:13638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c68e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13638:1876403964470272:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1789478510.608855:0:13638:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1789478510.608919:0:13638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c68e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13638:1876403964470400:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789478510.608978:0:13638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478510.609073:0:13638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc3c8a6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478510.612477:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964470400 00000100:00100000:3.0:1789478510.612490:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964470400 00000100:00100000:2.0:1789478510.612689:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789478510.612700:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:13638:x1876403964470400:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789478510.612910:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:13638:x1876403964470400:12345-0@lo:1000:mdt00_004.0 Request processed in 210us (3929us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789478510.612917:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789478510.613114:0:13638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c68e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13638:1876403964470400:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1789478510.613159:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e821672e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.613169:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e821672e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.613177:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e821672e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.613183:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc421edc00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478510.613187:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e821672e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.613194:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e821672e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.613208:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ebc02c13d00) 00010000:00010000:0.0:1789478510.613211:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789478510.613216:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e821672e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.613222:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e821672e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.613244:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216671 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.613250:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216671 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.613257:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216671 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.613275:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478510.613279:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216671 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.613286:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216671 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.613296:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:0.0:1789478510.613299:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789478510.613305:0:13638:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4be00/0x8ebaae74e8216678 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7436 expref: 19 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.613316:0:13638:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4be00/0x8ebaae74e8216678 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7436 expref: 19 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.613324:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4be00/0x8ebaae74e8216678 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7436 expref: 19 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.613428:0:13638:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4be00/0x8ebaae74e8216678 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7436 expref: 19 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478510.613442:0:13638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c5b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13638:1876403964470528:192.168.206.11@tcp:105: 00000100:00100000:1.0:1789478510.613560:0:13638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb02647600 going to sleep for 11 seconds 00000100:00100000:2.0:1789478510.618299:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478510.618415:0:13638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c5b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13638:1876403964470528:192.168.206.11@tcp:105: 00010000:00010000:1.0:1789478510.618453:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216671 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.618462:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216671 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.618498:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8216735 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.618511:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8216735 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.618522:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8216735 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.618533:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8216735 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.618540:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8216735 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.618546:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8216735 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.618551:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4b800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478510.618555:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8216735 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.618562:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8216735 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.618572:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:1.0:1789478510.618574:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478510.618584:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8216735 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.618589:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8216735 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.618630:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216727 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.618636:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216727 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.618642:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216727 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.618648:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77e00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478510.618651:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216727 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.618657:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216727 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.618665:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:1.0:1789478510.618667:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789478510.618670:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216727 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478510.618674:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216727 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478510.618807:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+19:11377:x1876403945535744:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 24231us (24432us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1789478510.618816:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 139 00000020:00080000:1.0:1789478510.618827:0:13638:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789478510.619130:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789478510.619136:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1789478510.619331:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945536128 00000100:00100000:3.0:1789478510.619337:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945536128 00000100:00100000:3.0:1789478510.619390:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 31 00000100:00100000:3.0:1789478510.619399:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3fca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+19:11376:x1876403945536128:12345-192.168.206.11@tcp:49:lfs.0 00000100:00100000:3.0:1789478510.619498:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3fca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+19:11376:x1876403945536128:12345-192.168.206.11@tcp:49:lfs.0 Request processed in 100us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478510.619504:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 31 00000040:00080000:0.0:1789478510.620627:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789478510.620648:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789478510.621674:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478510.621779:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945536384 00000100:00100000:3.0:1789478510.621788:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945536384 00000100:00100000:3.0:1789478510.621833:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 32 00000100:00100000:3.0:1789478510.621842:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc0838ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+19:11377:x1876403945536384:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789478510.622268:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789478510.622623:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1789478510.622789:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e821673c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.622830:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e821673c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.622841:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e821673c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.622850:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e821673c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.622856:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e821673c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.622862:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e821673c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478510.622932:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789478510.622998:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478510.623016:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc0838ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+21:11377:x1876403945536384:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 1175us (1348us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789478510.623023:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 32 00000020:00080000:3.0:1789478510.623028:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789478510.623115:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945536640 00000100:00100000:1.0:1789478510.623120:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945536640 00000100:00100000:1.0:1789478510.623162:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 140 00000100:00100000:1.0:1789478510.623170:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3fcaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+21:11376:x1876403945536640:12345-192.168.206.11@tcp:58:lfs.0 00000040:00080000:1.0:1789478510.623274:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1789478510.623323:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3fcaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+21:11376:x1876403945536640:12345-192.168.206.11@tcp:58:lfs.0 Request processed in 154us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478510.623330:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 140 00010000:00010000:0.0:1789478510.624086:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789478510.624094:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e821673c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.624102:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fce00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:0.0:1789478510.624107:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e821673c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.624125:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e821673c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.624266:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ebc02c13d00) 00010000:00010000:0.0:1789478510.624270:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789478510.624275:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e821673c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.624281:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e821673c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.624293:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478510.624295:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478510.624297:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478510.652836:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478510.653012:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945536768 00000100:00100000:0.0:1789478510.653021:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945536768 00000100:00100000:0.0:1789478510.653242:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 141 00000100:00100000:0.0:1789478510.653254:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3fca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+21:11379:x1876403945536768:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1789478510.653276:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478510.653294:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e8216743 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b746e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.653364:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e821674a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.653377:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e821674a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.653398:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e821674a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.653434:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ede00/0x8ebaae74e8216751 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.653442:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ede00/0x8ebaae74e8216751 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.653449:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ede00/0x8ebaae74e8216751 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.653517:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e8216758 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.653529:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216663 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b742f expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.653537:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e8216758 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.653568:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216663 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b742f expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.653581:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216663 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b742f expref: 22 pid: 6519 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478510.653633:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1876403964470656:192.168.206.11@tcp:104: 00000100:00100000:0.0:1789478510.653710:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc3c8a6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789478510.655558:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1876403964470656:192.168.206.11@tcp:104: 00010000:00010000:0.0:1789478510.655582:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e8216758 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478510.656899:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478510.657010:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945537024 00000100:00100000:1.0:1789478510.657018:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945537024 00000100:00100000:1.0:1789478510.657156:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 33 00000100:00100000:1.0:1789478510.657167:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3fcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+23:6162:x1876403945537024:12345-192.168.206.11@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789478510.657364:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3fcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+24:6162:x1876403945537024:12345-192.168.206.11@tcp:35:ldlm_bl.0 Request processed in 198us (468us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789478510.657372:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 33 00000100:00100000:2.0:1789478510.664097:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478510.664240:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945537152 00000100:00100000:0.0:1789478510.664249:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945537152 00010000:00010000:0.0:1789478510.664284:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216663 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b742f expref: 24 pid: 6519 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478510.664379:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 78 00000100:00100000:0.0:1789478510.664390:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3fca9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+24:2396:x1876403945537152:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478510.664405:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478510.664411:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216663 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b742f expref: 24 pid: 6519 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.664424:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216663 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b742f expref: 24 pid: 6519 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.664444:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216663 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b742f expref: 24 pid: 6519 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.664459:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:0.0:1789478510.664463:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e8216758 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.664472:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e8216758 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.664480:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e8216758 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478510.664509:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478510.664576:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3fca9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+23:2396:x1876403945537152:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 187us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478510.664589:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 78 00010000:00010000:2.0:1789478510.664812:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e8216758 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.664820:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e8216758 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478510.664867:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789478510.664872:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789478510.664890:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e8216758 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.664901:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e8216758 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.664910:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e821674a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.664917:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e821674a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.664923:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e821674a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.664929:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc421ec200 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478510.664933:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e821674a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.664939:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e821674a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.664949:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:2.0:1789478510.664951:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478510.665031:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e821674a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.665039:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ec200/0x8ebaae74e821674a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.665052:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ede00/0x8ebaae74e8216751 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.665058:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ede00/0x8ebaae74e8216751 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.665064:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ede00/0x8ebaae74e8216751 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.665068:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc421ede00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478510.665071:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ede00/0x8ebaae74e8216751 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.665076:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ede00/0x8ebaae74e8216751 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.665102:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ebc40e80300) 00010000:00010000:2.0:1789478510.665105:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478510.665108:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ede00/0x8ebaae74e8216751 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.665113:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ede00/0x8ebaae74e8216751 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.665156:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421edc00/0x8ebaae74e8216743 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b746e expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.665773:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e8216758 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b746e expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478510.665782:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:2.0:1789478510.665784:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789478510.665786:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc421eca00, rc 0) 00000100:00100000:2.0:1789478510.665838:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3fca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+22:11379:x1876403945536768:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 12587us (13010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478510.665847:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 141 00000100:00100000:2.0:1789478510.719003:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478510.719043:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478510.719080:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478510.719113:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478510.719138:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478510.719163:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945537280 00000100:00100000:0.0:1789478510.719172:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945537280 00000100:00100000:0.0:1789478510.719220:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 371 00000100:00100000:0.0:1789478510.719230:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2395:x1876403945537280:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478510.719291:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2395:x1876403945537280:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 63us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478510.719298:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 371 00000100:00100000:1.0:1789478510.719408:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945537536 00000100:00100000:1.0:1789478510.719413:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945537536 00000100:00100000:1.0:1789478510.719442:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 115 00000100:00100000:1.0:1789478510.719449:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3fcab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945537536:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478510.719457:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945537408 00000100:00100000:0.0:1789478510.719461:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945537408 00000100:00100000:1.0:1789478510.719484:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3fcab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945537536:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 36us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478510.719490:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945537664 00000100:00100000:1.0:1789478510.719492:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 115 00000100:00100000:0.0:1789478510.719493:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945537664 00000100:00100000:0.0:1789478510.719510:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945537792 00000100:00100000:0.0:1789478510.719512:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945537792 00000100:00100000:0.0:1789478510.719527:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 242 00000100:00100000:0.0:1789478510.719533:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3fca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945537408:12345-192.168.206.11@tcp:400:kworker.0 00000100:00080000:1.0:1789478510.719541:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789478510.719544:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789478510.719555:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 243 00000100:00100000:1.0:1789478510.719562:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3fca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2395:x1876403945537664:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478510.719563:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3fca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945537408:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 31us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478510.719569:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 242 00000100:00100000:0.0:1789478510.719580:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 244 00000100:00100000:0.0:1789478510.719585:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3fcab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2395:x1876403945537792:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478510.720048:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3fca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2395:x1876403945537664:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 484us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478510.720056:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 243 00000100:00100000:0.0:1789478510.721363:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3fcab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2395:x1876403945537792:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 1770us (2216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478510.721374:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 244 00000100:00100000:0.0:1789478510.821384:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789478510.821405:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964470784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789478510.821465:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478510.821546:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964470784 00000100:00100000:1.0:1789478510.821554:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964470784 00000100:00100000:1.0:1789478510.821635:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789478510.821645:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964470784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789478510.821665:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3691950080 00000100:00100000:1.0:1789478510.821710:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964470784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478510.821716:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789478510.821758:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964470784:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789478510.821898:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789478511.143919:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789478511.543771:0:14305:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789478511.543780:0:14305:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789478511.543809:0:14305:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789478511.543816:0:14305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1789478511.655182:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789478511.655191:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789478511.655224:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789478511.655233:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789478511.655367:0:13792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ffbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876403964470912:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789478511.655531:0:13792:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc082ccd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789478511.662219:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478511.662314:0:13792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ffbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876403964470912:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789478511.666279:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945537920 00000100:00100000:2.0:1789478511.666292:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945537920 00000100:00100000:3.0:1789478511.669580:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 142 00000100:00100000:3.0:1789478511.669617:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+22:11391:x1876403945537920:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789478511.669755:0:6519:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789478511.670236:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+22:11391:x1876403945537920:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 643us (8022us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478511.670245:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 142 00000100:00100000:1.0:1789478511.693260:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478511.697517:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945538176 00000100:00100000:2.0:1789478511.697530:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945538176 00000100:00100000:2.0:1789478511.697670:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 143 00000100:00100000:2.0:1789478511.697682:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+22:11391:x1876403945538176:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789478511.697701:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478511.697719:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e821675f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7475 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478511.697815:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216766 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478511.699716:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216766 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478511.699736:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216766 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478511.699754:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789478511.699870:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e821675f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7475 expref: 25 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478511.699886:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216766 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7475 expref: 24 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478511.699895:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:2.0:1789478511.699898:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789478511.699901:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76800, rc 0) 00000100:00100000:2.0:1789478511.700100:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+24:11391:x1876403945538176:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 2420us (6847us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1789478511.700108:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 143 00000100:00100000:3.0:1789478511.704964:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478511.705228:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945538432 00000100:00100000:2.0:1789478511.705237:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945538432 00000100:00100000:2.0:1789478511.705283:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 144 00000100:00100000:2.0:1789478511.705293:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+24:11391:x1876403945538432:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789478511.705369:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216774 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478511.705384:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216774 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478511.705408:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216774 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478511.705549:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216774 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478511.705557:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216774 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478511.705564:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216774 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478511.705569:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76e00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478511.705573:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216774 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478511.705580:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216774 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478511.705611:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:2.0:1789478511.705615:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789478511.705620:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216774 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478511.705626:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216774 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478511.705963:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+25:11391:x1876403945538432:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 670us (1005us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1789478511.705971:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 144 00000040:00080000:2.0:1789478511.706127:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789478511.706131:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789478511.708189:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789478511.708203:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789478511.721139:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478511.722165:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478511.722196:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945538816 00000100:00100000:0.0:1789478511.722204:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945538816 00000100:00100000:0.0:1789478511.722257:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:0.0:1789478511.722267:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+25:2395:x1876403945538816:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478511.722281:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478511.722303:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216766 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7475 expref: 25 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478511.722320:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:0.0:1789478511.722325:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478511.722382:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+24:2395:x1876403945538816:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 116us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478511.722389:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:2.0:1789478511.723075:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945538688 00000100:00100000:2.0:1789478511.723081:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945538688 00000100:00100000:2.0:1789478511.723113:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 34 00000100:00100000:2.0:1789478511.723120:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+24:11391:x1876403945538688:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789478511.723277:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+25:11391:x1876403945538688:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 156us (2146us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1789478511.723283:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 34 00010000:00010000:2.0:1789478512.164735:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478512.357136:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964471040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478512.357200:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478512.357265:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964471040 00000100:00100000:1.0:1789478512.357272:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964471040 00000100:00100000:1.0:1789478512.357326:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789478512.357345:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964471040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789478512.357377:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789478512.357421:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964471040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478512.357428:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789478512.357488:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964471040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789478512.357983:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964471168:0@lo:400:kworker.0 00000100:00100000:0.0:1789478512.358021:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478512.358048:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964471680:0@lo:400:kworker.0 00000100:00100000:0.0:1789478512.358075:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478512.358090:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876403964472192:0@lo:400:kworker.0 00000100:00100000:0.0:1789478512.358110:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478512.358127:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789478512.358139:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964471296:0@lo:400:kworker.0 00000100:00100000:0.0:1789478512.358163:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478512.358180:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964471808:0@lo:400:kworker.0 00000100:00100000:0.0:1789478512.358200:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478512.358216:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03675500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964472320:0@lo:400:kworker.0 00000100:00100000:0.0:1789478512.358233:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478512.358257:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964471680 00000100:00100000:0.0:1789478512.358261:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964471680 00000100:00100000:0.0:1789478512.358363:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964472192 00000100:00100000:0.0:1789478512.358367:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964472192 00000100:00100000:0.0:1789478512.358384:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964471296 00000100:00100000:0.0:1789478512.358387:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964471296 00000100:00100000:0.0:1789478512.358397:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964471808 00000100:00100000:0.0:1789478512.358399:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964471808 00000100:00100000:0.0:1789478512.358409:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964472320 00000100:00100000:0.0:1789478512.358410:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964472320 00000100:00100000:0.0:1789478512.358762:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789478512.358771:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964471680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478512.358814:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964471680:12345-0@lo:400:kworker.0 Request processed in 45us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478512.358820:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789478512.358835:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789478512.358840:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876403964472192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478512.358863:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876403964472192:12345-0@lo:400:kworker.0 Request processed in 23us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478512.358868:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789478512.358879:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789478512.358884:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964471296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478512.358918:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964471296:12345-0@lo:400:kworker.0 Request processed in 33us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478512.358924:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789478512.358935:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789478512.358941:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964471808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478512.358965:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964471808:12345-0@lo:400:kworker.0 Request processed in 25us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478512.358971:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789478512.358981:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789478512.358987:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964472320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478512.359011:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964472320:12345-0@lo:400:kworker.0 Request processed in 25us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478512.359017:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00080000:0.0:1789478512.359033:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789478512.359036:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789478512.359058:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964471296:0@lo:400:kworker.0 00010000:00080000:0.0:1789478512.359071:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03353b80 x1876403964471808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478512.359080:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964471808:0@lo:400:kworker.0 00010000:00080000:0.0:1789478512.359089:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03675500 x1876403964472320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478512.359097:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03675500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964472320:0@lo:400:kworker.0 00000100:00100000:0.0:1789478512.359107:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964471680:0@lo:400:kworker.0 00000100:00100000:0.0:1789478512.359127:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876403964472192:0@lo:400:kworker.0 00000100:00100000:1.0:1789478512.359804:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964471168 00000100:00100000:1.0:1789478512.359812:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964471168 00000100:00100000:1.0:1789478512.359862:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1789478512.359870:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964471168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478512.359923:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964471168:12345-0@lo:400:kworker.0 Request processed in 54us (1901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478512.359929:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1789478512.359966:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964471424:0@lo:400:kworker.0 00000100:00100000:1.0:1789478512.359995:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478512.360017:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964471936:0@lo:400:kworker.0 00000100:00100000:1.0:1789478512.360039:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478512.360056:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964472448:0@lo:400:kworker.0 00000100:00100000:1.0:1789478512.360076:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478512.360093:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789478512.360098:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964471552:0@lo:400:kworker.0 00000100:00100000:1.0:1789478512.360121:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478512.360134:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964472064:0@lo:400:kworker.0 00000100:00100000:1.0:1789478512.360153:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478512.360168:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03677100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964472576:0@lo:400:kworker.0 00000100:00100000:1.0:1789478512.360189:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478512.360211:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964471936 00000100:00100000:1.0:1789478512.360214:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964471936 00000100:00100000:1.0:1789478512.360240:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964472448 00000100:00100000:1.0:1789478512.360243:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964472448 00000100:00100000:1.0:1789478512.360256:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964472064 00000100:00100000:1.0:1789478512.360266:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964472064 00000100:00100000:1.0:1789478512.360281:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964472576 00000100:00100000:1.0:1789478512.360283:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964472576 00000100:00100000:3.0:1789478512.360438:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789478512.360447:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964471936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478512.360488:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964471936:12345-0@lo:400:kworker.0 Request processed in 43us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478512.360494:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789478512.360508:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789478512.360513:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964472448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478512.360542:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964472448:12345-0@lo:400:kworker.0 Request processed in 30us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478512.360548:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789478512.360559:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789478512.360564:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3645:x1876403964472064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478512.360622:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3645:x1876403964472064:12345-0@lo:400:kworker.0 Request processed in 58us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478512.360628:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789478512.360647:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789478512.360653:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1876403964472576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478512.360682:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1876403964472576:12345-0@lo:400:kworker.0 Request processed in 29us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478512.360687:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789478512.360725:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964472064:0@lo:400:kworker.0 00000100:00100000:3.0:1789478512.360734:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03677100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964472576:0@lo:400:kworker.0 00000100:00100000:3.0:1789478512.360742:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964471936:0@lo:400:kworker.0 00000100:00100000:3.0:1789478512.360749:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964472448:0@lo:400:kworker.0 00000100:00100000:3.0:1789478512.360778:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964471168:0@lo:400:kworker.0 00000100:00100000:3.0:1789478512.360806:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964471424 00000100:00100000:3.0:1789478512.360809:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964471424 00000100:00100000:3.0:1789478512.360837:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789478512.360844:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964471424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478512.360878:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964471424:12345-0@lo:400:kworker.0 Request processed in 34us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478512.360884:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789478512.360910:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964471424:0@lo:400:kworker.0 00000100:00080000:0.0:1789478512.363985:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789478512.363993:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789478512.364008:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964471552 00000100:00100000:0.0:1789478512.364018:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964471552 00000100:00100000:0.0:1789478512.364072:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789478512.364082:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964471552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478512.364163:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964471552:12345-0@lo:400:kworker.0 Request processed in 83us (4040us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478512.364169:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789478512.364211:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964471552:0@lo:400:kworker.0 00000100:00100000:3.0:1789478512.365322:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3fca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964472704:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789478512.365377:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478512.365489:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964472704 00000100:00100000:1.0:1789478512.365495:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964472704 00000100:00100000:1.0:1789478512.365536:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789478512.365544:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964472704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789478512.365569:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789478512.366011:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964472704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 467us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478512.366019:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789478512.366077:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3fca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964472704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789478512.869033:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964472832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789478512.869108:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478512.869278:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964472832 00000100:00100000:3.0:1789478512.869286:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964472832 00000100:00100000:3.0:1789478512.869361:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789478512.869371:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3fcaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1876403964472832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789478512.869396:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789478512.875898:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964472960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789478512.876355:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964472832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789478512.876992:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3fcaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1876403964472832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7620us (7881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478512.877003:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789478512.881660:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478512.882830:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964472960 00000100:00100000:2.0:1789478512.882842:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964472960 00000100:00100000:0.0:1789478512.883447:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789478512.883463:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964472960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789478512.883647:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789478512.883724:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964472960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 266us (2071us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478512.883731:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789478512.883880:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964472960:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789478513.191039:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789478513.584055:0:14356:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789478513.584064:0:14356:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789478513.584098:0:14356:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789478513.584106:0:14356:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789478513.852044:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478513.852681:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945539072 00000100:00100000:0.0:1789478513.852690:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945539072 00000100:00080000:1.0:1789478513.852722:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789478513.852748:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 145 00000100:00100000:0.0:1789478513.852764:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+25:11412:x1876403945539072:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1789478513.852785:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478513.852816:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e821677b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b747c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478513.852972:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e8216782 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478513.852986:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e8216782 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478513.852996:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e8216782 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789478513.853007:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789478513.853169:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e821677b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b747c expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478513.853186:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e8216782 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b747c expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478513.853196:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:0.0:1789478513.853198:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789478513.853202:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b67e00, rc 0) 00000100:00100000:0.0:1789478513.853261:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+27:11412:x1876403945539072:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 499us (1225us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789478513.853269:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 145 00000100:00100000:3.0:1789478513.857771:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478513.857883:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945539200 00000100:00100000:0.0:1789478513.857894:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945539200 00000100:00100000:0.0:1789478513.858009:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 146 00000100:00100000:0.0:1789478513.858021:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+27:11412:x1876403945539200:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:0.0:1789478513.858095:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216790 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478513.858111:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478513.858121:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478513.858154:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478513.858161:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216790 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478513.858168:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216790 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478513.858174:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478513.858179:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216790 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478513.858186:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216790 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478513.858198:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:0.0:1789478513.858201:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789478513.858205:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216790 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478513.858211:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216790 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478513.858288:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+27:11412:x1876403945539200:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 269us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478513.858296:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 146 00000100:00100000:1.0:1789478513.956575:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478513.956806:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945539328 00000100:00100000:3.0:1789478513.956816:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945539328 00000100:00100000:3.0:1789478513.956923:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 54 00000100:00100000:3.0:1789478513.956943:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2396:x1876403945539328:12345-192.168.206.11@tcp:101:cat.0 00010000:00010000:3.0:1789478513.956959:0:8829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478513.956978:0:8829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008695a243/0x8ebaae74e8216797 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7483 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789478513.957001:0:8829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa9466d, atime: 0x6aa9466d, ctime: 0x6aa9466d, blocks: 0x8 00010000:00010000:3.0:1789478513.957018:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=343s v=(0 0) 00010000:00010000:3.0:1789478513.957022:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478513.957031:0:8829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008695a243/0x8ebaae74e8216797 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7483 expref: 7 pid: 8829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478513.957050:0:8829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008695a243/0x8ebaae74e8216797 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7483 expref: 7 pid: 8829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478513.957076:0:8829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fd000, rc 0) 00000100:00100000:3.0:1789478513.957369:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2396:x1876403945539328:12345-192.168.206.11@tcp:101:cat.0 Request processed in 428us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478513.957376:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 54 00000100:00080000:1.0:1789478513.957723:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789478513.961003:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478513.961397:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945539456 00000100:00100000:0.0:1789478513.961406:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945539456 00002000:00100000:0.0:1789478513.961452:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8ebc09126680 x1876403945539456/t0(0) o3->327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp:174/0 lens 488/0 e 0 to 0 dl 1789478524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789478513.961462:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ebc09126680 with x1876403945539456 ext(0->4095) 00002000:00010000:0.0:1789478513.961468:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ebc09126680 00000100:00100000:0.0:1789478513.961499:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:0.0:1789478513.961509:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2396:x1876403945539456:12345-192.168.206.11@tcp:3:cat.0 00000100:00100000:0.0:1789478513.961846:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2396:x1876403945539456:12345-192.168.206.11@tcp:3:cat.0 Request processed in 338us (850us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789478513.961854:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 3 00002000:00100000:0.0:1789478513.961861:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8ebc09126680 x1876403945539456/t0(0) o3->327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp:174/0 lens 488/4536 e 0 to 0 dl 1789478524 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789478513.961870:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ebc09126680 with x1876403945539456 ext(0->4095) 00002000:00010000:0.0:1789478513.961873:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ebc09126680 00010000:00010000:1.0:1789478514.213215:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478515.237141:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478515.428927:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3fca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964473088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789478515.428998:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478515.429459:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964473088 00000100:00100000:1.0:1789478515.429467:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964473088 00000100:00100000:1.0:1789478515.429539:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789478515.429550:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876403964473088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789478515.429586:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789478515.429656:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876403964473088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478515.429663:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789478515.429705:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3fca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964473088:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789478515.429833:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789478515.840267:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478515.840309:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478515.840356:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478515.840396:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478515.840418:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478515.840434:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478515.840623:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945539712 00000100:00100000:0.0:1789478515.840632:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945539712 00000100:00100000:0.0:1789478515.840687:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945540224 00000100:00100000:0.0:1789478515.840690:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945540224 00000100:00100000:0.0:1789478515.840710:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945539840 00000100:00100000:0.0:1789478515.840713:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945539840 00000100:00100000:0.0:1789478515.840729:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 251 00000100:00100000:0.0:1789478515.840752:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3fca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+27:2398:x1876403945539712:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478515.840828:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3fca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+27:2398:x1876403945539712:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 71us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478515.840835:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 251 00000100:00100000:0.0:1789478515.840852:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 252 00000100:00100000:0.0:1789478515.840859:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3fca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2398:x1876403945540224:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478515.840884:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3fca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2398:x1876403945540224:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 26us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478515.840890:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 252 00000100:00100000:0.0:1789478515.840902:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 253 00000100:00100000:0.0:1789478515.840909:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3fca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2398:x1876403945539840:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478515.840932:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3fca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2398:x1876403945539840:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 24us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478515.840938:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 253 00000100:00100000:0.0:1789478515.840957:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945539584 00000100:00100000:0.0:1789478515.840961:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945539584 00000100:00100000:0.0:1789478515.840983:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 373 00000100:00100000:0.0:1789478515.840989:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2398:x1876403945539584:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478515.841012:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2398:x1876403945539584:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 23us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478515.841018:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 373 00000100:00080000:0.0:1789478515.841130:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789478515.841134:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789478515.841199:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478515.841881:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945539968 00000100:00100000:3.0:1789478515.841887:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945539968 00000100:00100000:3.0:1789478515.841941:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945540096 00000100:00100000:3.0:1789478515.841945:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945540096 00000100:00100000:3.0:1789478515.841968:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 120 00000100:00100000:3.0:1789478515.841977:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3fca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2398:x1876403945539968:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478515.842020:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3fca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2398:x1876403945539968:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 45us (1710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478515.842026:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 120 00000100:00100000:3.0:1789478515.842038:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 121 00000100:00100000:3.0:1789478515.842044:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2398:x1876403945540096:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478515.842068:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2398:x1876403945540096:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 24us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478515.842074:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 121 00000100:00100000:1.0:1789478515.842509:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945540352 00000100:00100000:1.0:1789478515.842514:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945540352 00000100:00100000:1.0:1789478515.842558:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 254 00000100:00100000:1.0:1789478515.842567:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2398:x1876403945540352:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478515.842643:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2398:x1876403945540352:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 76us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478515.842649:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 254 00000100:00080000:2.0:1789478515.842945:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789478515.842955:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789478515.842957:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789478515.941909:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964473216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789478515.941986:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478515.942261:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964473216 00000100:00100000:0.0:1789478515.942275:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964473216 00000100:00100000:0.0:1789478515.942351:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789478515.942361:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964473216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789478515.942382:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478515.942444:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964473216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478515.942698:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789478515.942971:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964473216:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789478515.942994:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789478515.945558:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1789478515.945573:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1789478515.945794:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1789478515.945835:0:6496:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ebc3c8a6180 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1789478515.945841:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ebb03625500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ebc3c8a6600 00000020:00080000:2.0:1789478515.945844:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ebb03625f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ebb034dbc00 00000020:00080000:2.0:1789478515.945866:0:6496:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:1.0:1789478515.945937:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e8216712 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478515.945947:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e8216712 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478515.945955:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e8216712 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478515.945961:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc421ed600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478515.945966:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e8216712 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478515.945973:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e8216712 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478515.945990:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ebc02c13d00) 00010000:00010000:1.0:1789478515.945993:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478515.945998:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e8216712 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478515.946004:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421ed600/0x8ebaae74e8216712 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789478515.946422:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1789478515.946502:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:3.0:1789478515.947441:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000040:00080000:0.0:1789478516.069450:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789478516.260750:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789478516.841985:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789478516.841993:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789478516.842010:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789478516.842018:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789478517.285105:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478517.477011:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789478517.477033:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964473344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478517.477104:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478517.477173:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964473728:0@lo:400:kworker.0 00000100:00100000:1.0:1789478517.477197:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478517.477225:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c94ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964474240:0@lo:400:kworker.0 00000100:00100000:1.0:1789478517.477249:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478517.477273:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964474752:0@lo:400:kworker.0 00000100:00100000:1.0:1789478517.477320:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478517.477338:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789478517.477343:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964473856:0@lo:400:kworker.0 00000100:00100000:1.0:1789478517.477362:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478517.477379:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c94f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964474368:0@lo:400:kworker.0 00000100:00100000:1.0:1789478517.477396:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478517.477409:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964474880:0@lo:400:kworker.0 00000100:00100000:1.0:1789478517.477424:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478517.477444:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876403964473600:0@lo:400:kworker.0 00000100:00100000:1.0:1789478517.477461:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478517.477474:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c94d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876403964474112:0@lo:400:kworker.0 00000100:00100000:0.0:1789478517.477759:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964473472:0@lo:400:kworker.0 00000100:00100000:2.0:1789478517.477773:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964474240 00000100:00100000:2.0:1789478517.477781:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964474240 00000100:00100000:0.0:1789478517.477795:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478517.477815:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964473984:0@lo:400:kworker.0 00000100:00100000:2.0:1789478517.477824:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964474752 00000100:00100000:2.0:1789478517.477827:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964474752 00000100:00100000:0.0:1789478517.477835:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478517.477851:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964474496:0@lo:400:kworker.0 00000100:00100000:0.0:1789478517.477870:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478517.477884:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964473344 00000100:00100000:3.0:1789478517.477888:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964473344 00000100:00100000:3.0:1789478517.477912:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964473728 00000100:00100000:3.0:1789478517.477915:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964473728 00000100:00100000:3.0:1789478517.477935:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964473856 00000100:00100000:3.0:1789478517.477938:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964473856 00000100:00100000:3.0:1789478517.477954:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789478517.477961:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964475008:0@lo:400:kworker.0 00000100:00100000:3.0:1789478517.477962:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1876403964473344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789478517.477991:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1789478517.478036:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1876403964473344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478517.478043:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789478517.478058:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789478517.478064:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964473728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478517.478075:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478517.478090:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964473728:12345-0@lo:400:kworker.0 Request processed in 27us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478517.478094:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789478517.478096:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789478517.478106:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789478517.478109:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3cbc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964475136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789478517.478112:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964473856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478517.478130:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478517.478134:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964473856:12345-0@lo:400:kworker.0 Request processed in 23us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478517.478139:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789478517.478148:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964475136 00000100:00100000:3.0:1789478517.478158:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964475136 00000100:00100000:3.0:1789478517.478174:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789478517.478180:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964475136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789478517.478195:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789478517.478272:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478517.479047:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876403964474624:0@lo:400:kworker.0 00000100:00100000:1.0:1789478517.479071:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478517.479093:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964473600 00000100:00100000:2.0:1789478517.479097:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964473600 00000100:00100000:2.0:1789478517.479117:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964473984 00000100:00100000:2.0:1789478517.479119:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964473984 00000100:00100000:2.0:1789478517.479128:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964474112 00000100:00100000:2.0:1789478517.479130:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964474112 00000100:00100000:2.0:1789478517.479144:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789478517.479151:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964474240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478517.479184:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964474240:12345-0@lo:400:kworker.0 Request processed in 34us (1934us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478517.479190:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789478517.479201:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789478517.479206:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964474752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478517.479227:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964474752:12345-0@lo:400:kworker.0 Request processed in 21us (1906us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478517.479232:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789478517.479241:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789478517.479245:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876403964473600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478517.479272:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876403964473600:12345-0@lo:400:kworker.0 Request processed in 26us (1809us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478517.479277:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789478517.479286:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789478517.479291:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964473984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478517.479363:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876403964473600:0@lo:400:kworker.0 00000100:00080000:1.0:1789478517.479387:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789478517.479390:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789478517.479399:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964474368 00000100:00100000:1.0:1789478517.479402:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964474368 00000100:00100000:1.0:1789478517.479425:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964474880 00000100:00100000:1.0:1789478517.479427:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964474880 00000100:00100000:1.0:1789478517.479436:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964474496 00000100:00100000:1.0:1789478517.479438:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964474496 00000100:00100000:1.0:1789478517.479447:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964475008 00000100:00100000:1.0:1789478517.479449:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964475008 00000100:00100000:1.0:1789478517.479460:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789478517.479465:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964474368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478517.479550:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964474368:12345-0@lo:400:kworker.0 Request processed in 84us (2152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478517.479556:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789478517.479567:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789478517.479572:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964474880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478517.479611:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964474880:12345-0@lo:400:kworker.0 Request processed in 39us (2186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478517.479616:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789478517.479627:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789478517.479632:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03677100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964474496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478517.480513:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964475136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2328us (2377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478517.480522:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789478517.480698:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789478517.480708:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03676a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964475008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478517.480816:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964474624 00000100:00100000:0.0:1789478517.480823:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964474624 00000100:00100000:0.0:1789478517.480852:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789478517.480861:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876403964474112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478517.481293:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964473984:12345-0@lo:400:kworker.0 Request processed in 1999us (3454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478517.481301:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789478517.481618:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03677100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964474496:12345-0@lo:400:kworker.0 Request processed in 1984us (3744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478517.481626:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1789478517.481652:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789478517.481657:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789478517.481667:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789478517.481700:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964473856:0@lo:400:kworker.0 00000100:00100000:1.0:1789478517.481713:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c94f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964474368:0@lo:400:kworker.0 00000100:00100000:1.0:1789478517.481725:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964474880:0@lo:400:kworker.0 00000100:00100000:1.0:1789478517.481736:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964473728:0@lo:400:kworker.0 00010000:00080000:1.0:1789478517.481750:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c94ca80 x1876403964474240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478517.481760:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c94ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964474240:0@lo:400:kworker.0 00010000:00080000:1.0:1789478517.481770:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40ed5880 x1876403964474752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478517.481778:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964474752:0@lo:400:kworker.0 00000100:00100000:1.0:1789478517.481791:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964473344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789478517.481900:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789478517.482020:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876403964474624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478517.482067:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876403964474624:12345-0@lo:400:kworker.0 Request processed in 160us (2994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478517.482073:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789478517.482133:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964473472 00000100:00100000:2.0:1789478517.482138:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964473472 00000100:00100000:2.0:1789478517.482164:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1789478517.482169:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3645:x1876403964473472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478517.482196:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3645:x1876403964473472:12345-0@lo:400:kworker.0 Request processed in 27us (4400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478517.482201:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1789478517.482421:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03676a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964475008:12345-0@lo:400:kworker.0 Request processed in 1713us (4343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478517.482428:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789478517.485650:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3cbc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964475136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789478517.485669:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964473472:0@lo:400:kworker.0 00000100:00100000:2.0:1789478517.485683:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964473984:0@lo:400:kworker.0 00000100:00100000:2.0:1789478517.485694:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1789478517.485705:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1789478517.485724:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ebb03dfd180, transno 4294967305 00000100:00100000:2.0:1789478517.485738:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964474496:0@lo:400:kworker.0 00000100:00100000:2.0:1789478517.485750:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1789478517.485753:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1789478517.485763:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964475008:0@lo:400:kworker.0 00000100:00100000:0.0:1789478517.490257:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876403964474112:12345-0@lo:400:kworker.0 Request processed in 9390us (11976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478517.490271:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789478517.492214:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c94d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876403964474112:0@lo:400:kworker.0 00000100:00100000:1.0:1789478517.492232:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876403964474624:0@lo:400:kworker.0 00000100:00100000:3.0:1789478517.988852:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789478517.988873:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964475264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789478517.988933:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478517.988987:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964475264 00000100:00100000:3.0:1789478517.988994:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964475264 00000100:00100000:3.0:1789478517.989049:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789478517.989058:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964475264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789478517.989083:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789478517.989133:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964475264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478517.989151:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789478517.989197:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964475264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789478517.992482:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789478517.992501:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964475392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789478517.992561:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478517.992621:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964475392 00000100:00100000:3.0:1789478517.992629:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964475392 00000100:00100000:3.0:1789478517.992668:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789478517.992677:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964475392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789478517.992694:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789478517.992730:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964475392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478517.992736:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789478517.992773:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964475392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789478518.210707:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478518.212301:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945540480 00000100:00100000:1.0:1789478518.212323:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945540480 00000100:00080000:2.0:1789478518.213692:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789478518.213779:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 147 00000100:00100000:2.0:1789478518.213794:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cbc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+13:11057:x1876403945540480:12345-192.168.206.11@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789478518.213898:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cbc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+13:11057:x1876403945540480:12345-192.168.206.11@tcp:60:lhsmtool_posix.0 Request processed in 108us (3199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478518.213906:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 147 00000100:00100000:3.0:1789478518.217589:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478518.217840:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945540608 00000100:00100000:2.0:1789478518.217849:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945540608 00000100:00100000:2.0:1789478518.217915:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 148 00000100:00100000:2.0:1789478518.217925:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:11057:x1876403945540608:12345-192.168.206.11@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789478518.218023:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:11057:x1876403945540608:12345-192.168.206.11@tcp:60:lhsmtool_posix.0 Request processed in 100us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478518.218031:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 148 00000100:00080000:3.0:1789478518.218087:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789478518.220731:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478518.220842:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945540864 00000100:00100000:1.0:1789478518.220852:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945540864 00000100:00100000:1.0:1789478518.222037:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 35 00000100:00100000:1.0:1789478518.222055:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+13:11057:x1876403945540864:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789478518.222267:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+14:11057:x1876403945540864:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 220us (1543us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789478518.222287:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 35 00010000:00010000:2.0:1789478518.308819:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478518.391724:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478518.391818:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945540992 00000100:00100000:0.0:1789478518.391826:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945540992 00000100:00100000:0.0:1789478518.391887:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 149 00000100:00100000:0.0:1789478518.391896:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:11870:x1876403945540992:12345-192.168.206.11@tcp:101:lsof.0 00010000:00010000:0.0:1789478518.391920:0:13638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478518.391936:0:13638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e821679e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b748a expref: -99 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478518.391992:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82167a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478518.392004:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82167a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478518.392015:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82167a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789478518.392060:0:13638:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789478518.392064:0:13638:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789478518.392104:0:13638:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82167a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478518.392125:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e821679e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b748a expref: 7 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478518.392148:0:13638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82167a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b748a expref: 6 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478518.392174:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc40e80800) 00010000:00010000:0.0:1789478518.392177:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789478518.392180:0:13638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b67c00, rc 0) 00000100:00100000:0.0:1789478518.392233:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+6:11870:x1876403945540992:12345-192.168.206.11@tcp:101:lsof.0 Request processed in 338us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478518.392239:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 149 00000100:00080000:3.0:1789478518.392858:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789478519.333879:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478520.357810:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478520.548955:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964475520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789478520.549020:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478520.549223:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964475520 00000100:00100000:3.0:1789478520.549231:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964475520 00000100:00100000:3.0:1789478520.549308:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789478520.549319:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964475520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789478520.549345:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1789478520.549467:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789478520.549633:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964475520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 316us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478520.549640:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789478520.549831:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964475520:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1789478520.740991:0:14553:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 09:21:59 (1789478519) 00000100:00100000:0.0:1789478520.958817:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478520.958889:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478520.958918:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478520.958956:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945541504 00000100:00100000:3.0:1789478520.958965:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945541504 00000100:00100000:3.0:1789478520.959032:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 126 00000100:00100000:3.0:1789478520.959042:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945541504:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478520.959117:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945541504:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 76us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478520.959125:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 126 00000100:00100000:0.0:1789478520.965876:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478520.965916:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478520.966052:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945541120 00000100:00100000:3.0:1789478520.966061:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945541120 00000100:00100000:3.0:1789478520.966105:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 375 00000100:00100000:3.0:1789478520.966114:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2397:x1876403945541120:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478520.966186:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2397:x1876403945541120:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 73us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478520.966193:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 375 00000100:00100000:1.0:1789478520.966430:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945541248 00000100:00100000:1.0:1789478520.966435:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945541248 00000100:00100000:1.0:1789478520.966472:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945541760 00000100:00100000:1.0:1789478520.966476:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945541760 00000100:00100000:1.0:1789478520.966500:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 261 00000100:00100000:1.0:1789478520.966507:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+14:2397:x1876403945541248:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478520.966556:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+14:2397:x1876403945541248:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 49us (7747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478520.966563:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 261 00000100:00100000:1.0:1789478520.966577:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 262 00000100:00100000:1.0:1789478520.966584:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+6:2397:x1876403945541760:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478520.966635:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+6:2397:x1876403945541760:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 51us (7716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478520.966640:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 262 00000100:00080000:1.0:1789478520.966657:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789478520.966662:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789478520.968087:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478520.968126:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478520.968178:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945541632 00000100:00100000:1.0:1789478520.968185:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945541632 00000100:00100000:1.0:1789478520.968226:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 127 00000100:00100000:1.0:1789478520.968235:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2397:x1876403945541632:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478520.968307:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2397:x1876403945541632:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 73us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478520.968323:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 127 00000100:00080000:1.0:1789478520.968341:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789478520.968756:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945541376 00000100:00100000:2.0:1789478520.968761:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945541376 00000100:00100000:2.0:1789478520.968801:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945541888 00000100:00100000:2.0:1789478520.968805:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945541888 00000100:00100000:2.0:1789478520.968824:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 263 00000100:00100000:2.0:1789478520.968832:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945541376:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1789478520.968869:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945541376:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 38us (2952us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478520.968876:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 263 00000100:00100000:2.0:1789478520.968890:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 264 00000100:00100000:2.0:1789478520.968896:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2397:x1876403945541888:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1789478520.968920:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2397:x1876403945541888:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 24us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478520.968927:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 264 00000100:00080000:1.0:1789478520.969454:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789478521.062195:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb01b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964475648:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789478521.062262:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478521.062336:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964475648 00000100:00100000:3.0:1789478521.062344:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964475648 00000100:00080000:0.0:1789478521.062397:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789478521.062414:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789478521.062435:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964475648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789478521.062454:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789478521.062509:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964475648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478521.062516:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789478521.062633:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb01b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964475648:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789478521.380761:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478522.009331:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478522.009422:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945542144 00000100:00100000:2.0:1789478522.009430:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945542144 00000100:00080000:0.0:1789478522.009545:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789478522.010147:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 150 00000100:00100000:2.0:1789478522.010161:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+14:12137:x1876403945542144:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789478522.010179:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478522.010196:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82167ac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7491 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.010257:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e82167b3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.010270:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e82167b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.010282:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e82167b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.010408:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82167ba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.010416:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82167ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.010422:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82167ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.010502:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e82167c1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.010510:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e82167c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.010516:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e82167c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478522.010524:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789478522.010621:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e82167b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.010628:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e82167b3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.010635:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e82167b3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.010640:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478522.010644:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e82167b3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.010662:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e82167b3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.010684:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ebc21ed2600) 00010000:00010000:2.0:1789478522.010687:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478522.010691:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e82167b3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.010698:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e82167b3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.010710:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82167ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.010715:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82167ba lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.010720:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82167ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.010725:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76e00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478522.010728:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82167ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.010733:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82167ba lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.010740:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ebc1046ff00) 00010000:00010000:2.0:1789478522.010742:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478522.010745:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82167ba lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.010760:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82167ba lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.012483:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82167ac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7491 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.012504:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e82167c1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7491 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478522.012513:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ebc40e36e00) 00010000:00010000:2.0:1789478522.012516:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478522.012518:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76800, rc 0) 00000100:00100000:2.0:1789478522.012783:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+16:12137:x1876403945542144:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 2625us (3458us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1789478522.012841:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 150 00000100:00100000:0.0:1789478522.017802:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478522.017831:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945542272 00000100:00100000:0.0:1789478522.017838:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945542272 00000100:00100000:3.0:1789478522.018166:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478522.018187:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945542400 00000100:00100000:3.0:1789478522.018190:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945542400 00000100:00100000:3.0:1789478522.018218:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 151 00000100:00100000:3.0:1789478522.018227:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+17:12137:x1876403945542400:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789478522.018316:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+17:12137:x1876403945542400:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 Request processed in 90us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478522.018338:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 151 00000100:00100000:3.0:1789478522.018374:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 11 00000100:00100000:3.0:1789478522.018380:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08341450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+16:2397:x1876403945542272:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789478522.018390:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478522.018411:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e82167c1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7491 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478522.018428:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ebc40e36e00) 00010000:00010000:3.0:1789478522.018433:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478522.018448:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08341450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+15:2397:x1876403945542272:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 69us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478522.018455:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 11 00000001:00080000:0.0:1789478522.019042:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:0.0:1789478522.019054:0:6496:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1789478522.019204:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789478522.019213:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1789478522.021316:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478522.021403:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945542528 00000100:00100000:1.0:1789478522.021411:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945542528 00000100:00100000:1.0:1789478522.021472:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 152 00000100:00100000:1.0:1789478522.021482:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:12137:x1876403945542528:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789478522.021554:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:12137:x1876403945542528:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 Request processed in 74us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478522.021561:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 152 00000100:00080000:0.0:1789478522.021685:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1789478522.213457:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789478522.410821:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478522.597413:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964475776:0@lo:400:kworker.0 00000100:00100000:3.0:1789478522.597474:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478522.597562:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964475776 00000100:00100000:2.0:1789478522.597570:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964475776 00000100:00100000:2.0:1789478522.597642:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1789478522.597652:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964475776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478522.598032:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964476288:0@lo:400:kworker.0 00000100:00100000:3.0:1789478522.598062:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478522.598216:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964475776:12345-0@lo:400:kworker.0 Request processed in 565us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478522.598224:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1789478522.598275:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964476032:0@lo:400:kworker.0 00000100:00100000:2.0:1789478522.598314:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478522.598334:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789478522.598340:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964476160:0@lo:400:kworker.0 00000100:00100000:2.0:1789478522.598373:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478522.598399:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964476032 00000100:00100000:2.0:1789478522.598404:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964476032 00000100:00100000:2.0:1789478522.598434:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789478522.598442:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964476032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478522.598478:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964476032:12345-0@lo:400:kworker.0 Request processed in 38us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478522.598485:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789478522.598503:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964476288 00000100:00100000:2.0:1789478522.598506:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964476288 00000100:00100000:2.0:1789478522.598528:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964476160 00000100:00100000:2.0:1789478522.598530:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964476160 00000100:00100000:2.0:1789478522.598542:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789478522.598548:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964476288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478522.598579:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964476288:12345-0@lo:400:kworker.0 Request processed in 31us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478522.598585:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789478522.598617:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789478522.598624:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964476160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478522.598652:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964476160:12345-0@lo:400:kworker.0 Request processed in 30us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478522.598658:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789478522.598696:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964476160:0@lo:400:kworker.0 00000100:00100000:2.0:1789478522.598708:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964476032:0@lo:400:kworker.0 00000100:00100000:2.0:1789478522.601404:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964475904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789478522.601474:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478522.601508:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964476416:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789478522.601531:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478522.601575:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964475904 00000100:00100000:2.0:1789478522.601582:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964475904 00000100:00100000:2.0:1789478522.601630:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964476416 00000100:00100000:2.0:1789478522.601633:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964476416 00000100:00100000:2.0:1789478522.601649:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789478522.601657:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964475904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789478522.601690:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1789478522.601735:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964475904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478522.601741:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789478522.601757:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789478522.601763:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964476416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789478522.601778:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789478522.601803:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964476416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 41us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478522.601809:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789478522.601856:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964475904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789478522.601871:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964476416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789478522.601890:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964475776:0@lo:400:kworker.0 00000100:00100000:3.0:1789478522.601915:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964476288:0@lo:400:kworker.0 00000100:00100000:2.0:1789478522.602794:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964476544:0@lo:400:kworker.0 00000100:00100000:2.0:1789478522.602834:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478522.602901:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964476544 00000100:00100000:3.0:1789478522.602907:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964476544 00000100:00100000:3.0:1789478522.602946:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789478522.602953:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964476544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478522.604302:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964476544:0@lo:400:kworker.0 00000100:00100000:2.0:1789478522.604322:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789478522.604340:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964476544:12345-0@lo:400:kworker.0 Request processed in 1384us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478522.604341:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964476672:0@lo:400:kworker.0 00000100:00100000:3.0:1789478522.604356:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789478522.604387:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478522.604403:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964476672 00000100:00100000:3.0:1789478522.604409:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964476672 00000100:00100000:3.0:1789478522.604663:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789478522.604672:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3f7ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964476672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478522.604724:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3f7ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964476672:12345-0@lo:400:kworker.0 Request processed in 54us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478522.604730:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789478522.604737:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964476672:0@lo:400:kworker.0 00000100:00100000:0.0:1789478522.610026:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876403964477184:0@lo:400:kworker.0 00000100:00100000:0.0:1789478522.610088:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478522.610179:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964476800:0@lo:400:kworker.0 00000100:00100000:2.0:1789478522.610211:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964476928:0@lo:400:kworker.0 00000100:00100000:0.0:1789478522.610272:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789478522.610280:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964477056:0@lo:400:kworker.0 00000100:00080000:1.0:1789478522.611797:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789478522.611818:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964477184 00000100:00100000:1.0:1789478522.611828:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964477184 00000100:00100000:1.0:1789478522.611887:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789478522.611897:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876403964477184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478522.612874:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478522.612931:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964477440:0@lo:400:kworker.0 00000100:00100000:2.0:1789478522.612970:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478522.613030:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478522.613031:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964476928 00000100:00100000:2.0:1789478522.613038:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964476928 00000100:00100000:3.0:1789478522.613041:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478522.613061:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964477568:0@lo:400:kworker.0 00000100:00100000:2.0:1789478522.613078:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964477440 00000100:00100000:3.0:1789478522.613079:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964477312:0@lo:400:kworker.0 00000100:00100000:2.0:1789478522.613082:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964477440 00000100:00100000:2.0:1789478522.613104:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964477056 00000100:00100000:2.0:1789478522.613108:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964477056 00000100:00100000:3.0:1789478522.613118:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478522.613141:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964476800 00000100:00100000:3.0:1789478522.613145:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964476800 00000100:00100000:1.0:1789478522.613174:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876403964477184:12345-0@lo:400:kworker.0 Request processed in 1277us (3084us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478522.613176:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964477312 00000100:00100000:3.0:1789478522.613181:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964477312 00000100:00100000:1.0:1789478522.613188:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789478522.613199:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789478522.613208:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964476928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478522.613252:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964476928:12345-0@lo:400:kworker.0 Request processed in 46us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478522.613258:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789478522.613275:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789478522.613297:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964477440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478522.613304:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789478522.613312:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789478522.613317:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964476800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478522.613325:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964477312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478522.613334:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964477440:12345-0@lo:400:kworker.0 Request processed in 51us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478522.613342:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789478522.613358:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789478522.613367:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964477056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478522.613379:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964477312:12345-0@lo:400:kworker.0 Request processed in 58us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478522.613404:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964477056:12345-0@lo:400:kworker.0 Request processed in 38us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478522.613420:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789478522.613424:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964476800:12345-0@lo:400:kworker.0 Request processed in 108us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478522.613472:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964476928:0@lo:400:kworker.0 00000100:00100000:2.0:1789478522.613484:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964477440:0@lo:400:kworker.0 00000100:00100000:0.0:1789478522.613576:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478522.613640:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876403964477184:0@lo:400:kworker.0 00000100:00100000:0.0:1789478522.613658:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964477056:0@lo:400:kworker.0 00000100:00100000:0.0:1789478522.613677:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964477568 00000100:00100000:0.0:1789478522.613681:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964477568 00000100:00100000:1.0:1789478522.613842:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789478522.613851:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789478522.613852:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1789478522.613862:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789478522.613865:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964477568:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789478522.613867:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789478522.613870:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789478522.613873:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789478522.613904:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03f88380 x1876403964477312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478522.613908:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964477568:12345-0@lo:400:kworker.0 Request processed in 44us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478522.613923:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789478522.613938:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964477312:0@lo:400:kworker.0 00000100:00100000:0.0:1789478522.613954:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964477568:0@lo:400:kworker.0 00010000:00080000:3.0:1789478522.613979:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03f8ad80 x1876403964476800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478522.613989:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964476800:0@lo:400:kworker.0 00000040:00080000:1.0:1789478522.986473:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789478522.986480:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789478522.988666:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789478522.988682:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789478523.111430:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964477696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789478523.111480:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478523.111521:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964477696 00000100:00100000:0.0:1789478523.111527:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964477696 00000100:00100000:0.0:1789478523.111559:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789478523.111566:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964477696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789478523.111612:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789478523.111646:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964477696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478523.111650:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789478523.111689:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964477824:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789478523.111690:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964477696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789478523.111729:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478523.111758:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964477824 00000100:00100000:0.0:1789478523.111762:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964477824 00000100:00100000:0.0:1789478523.111779:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789478523.111783:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964477824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789478523.111788:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789478523.111809:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964477824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 26us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478523.111813:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789478523.111830:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964477824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789478523.381798:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478523.381864:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945542656 00000100:00100000:0.0:1789478523.381873:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945542656 00000100:00100000:0.0:1789478523.381934:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 153 00000100:00100000:0.0:1789478523.381945:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+13:12179:x1876403945542656:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1789478523.381963:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478523.381986:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfc00/0x8ebaae74e82167cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7498 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.382042:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df200/0x8ebaae74e82167d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.382056:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df200/0x8ebaae74e82167d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.382076:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df200/0x8ebaae74e82167d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.382091:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e82167dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.382098:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e82167dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.382104:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e82167dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.382142:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df200/0x8ebaae74e82167d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.382148:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df200/0x8ebaae74e82167d6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.382153:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df200/0x8ebaae74e82167d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.382159:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029df200 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478523.382162:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df200/0x8ebaae74e82167d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.382169:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df200/0x8ebaae74e82167d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.382179:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc40e80800) 00010000:00010000:0.0:1789478523.382182:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478523.382186:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df200/0x8ebaae74e82167d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.382197:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df200/0x8ebaae74e82167d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.382210:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e82167dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.382223:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e82167dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.382228:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e82167dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.382232:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029de800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478523.382235:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e82167dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.382241:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e82167dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.382247:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ebc40e80b00) 00010000:00010000:0.0:1789478523.382250:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478523.382252:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e82167dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.382257:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e82167dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.382303:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfc00/0x8ebaae74e82167cf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7498 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.382326:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc40e80800) 00010000:00010000:0.0:1789478523.382328:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478523.382332:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfc00/0x8ebaae74e82167cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7498 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.382343:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029dfc00, rc 0) 00000100:00100000:0.0:1789478523.382391:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+13:12179:x1876403945542656:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 449us (602us total) trans 0 rc 301/301 00000100:00100000:0.0:1789478523.382398:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 153 00000100:00100000:3.0:1789478523.395068:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478523.395198:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945542912 00000100:00100000:0.0:1789478523.395207:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945542912 00000100:00100000:0.0:1789478523.395260:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 154 00000100:00100000:0.0:1789478523.395271:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+13:12179:x1876403945542912:12345-192.168.206.11@tcp:36:lfs.0 00010000:00010000:0.0:1789478523.395335:0:13638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478523.395359:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e8216123 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72bc expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.395375:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc40e80800) 00010000:00010000:0.0:1789478523.395378:0:13638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789478523.395427:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e82167e4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.395441:0:13638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82167a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b748a expref: 5 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.395449:0:13638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e82167e4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.395489:0:13638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82167a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b748a expref: 5 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.395502:0:13638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82167a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b748a expref: 5 pid: 13638 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478523.395517:0:13638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f88000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13638:1876403964477952:192.168.206.11@tcp:104: 00000100:00100000:0.0:1789478523.395583:0:13638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc359b69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478523.400552:0:13638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f88000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13638:1876403964477952:192.168.206.11@tcp:104: 00010000:00010000:3.0:1789478523.400634:0:13638:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e82167e4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478523.400662:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478523.401002:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945543040 00000100:00100000:3.0:1789478523.401015:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945543040 00010000:00010000:3.0:1789478523.401066:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82167a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b748a expref: 6 pid: 13638 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478523.401103:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 79 00000100:00100000:3.0:1789478523.401112:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+6:2395:x1876403945543040:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789478523.401124:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478523.401131:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82167a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b748a expref: 6 pid: 13638 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.401143:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82167a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b748a expref: 6 pid: 13638 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.401164:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e82167a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b748a expref: 6 pid: 13638 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.401186:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc40e80800) 00010000:00010000:3.0:1789478523.401191:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e82167e4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.401200:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e82167e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.401206:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e82167e4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.401231:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478523.401273:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2395:x1876403945543040:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 162us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478523.401296:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 79 00010000:00010000:2.0:1789478523.401309:0:13638:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e82167e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478523.401316:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e82167e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478523.401335:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e82167eb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478523.401345:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e82167eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478523.401353:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e82167eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.401954:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e82167f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.401964:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e82167f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.401970:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e82167f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789478523.401984:0:13638:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc43f001 reply state 00000000eaf9a48b transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e82167f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.401993:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e82167f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.401999:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:3.0:1789478523.402007:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789478523.402010:0:13638:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789478523.402015:0:13638:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789478523.402023:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e82167e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.402029:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e82167e4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.402036:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e82167e4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.402041:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029df000 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478523.402045:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e82167e4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.402052:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e82167e4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.402060:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc40e80800) 00010000:00010000:3.0:1789478523.402063:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478523.402066:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e82167e4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.402073:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e82167e4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789478523.402088:0:13638:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc43f001 reply state 00000000eaf9a48b transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e82167eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.402096:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e82167eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.402113:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ebc1046ff00) 00010000:00010000:3.0:1789478523.402115:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789478523.402117:0:13638:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789478523.402174:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+14:12179:x1876403945542912:12345-192.168.206.11@tcp:36:lfs.0 Request processed in 6904us (7113us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1789478523.402182:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 154 00000100:00080000:1.0:1789478523.402972:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789478523.436721:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478523.538720:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478523.538876:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945543168 00000100:00100000:2.0:1789478523.538885:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945543168 00000100:00100000:2.0:1789478523.538951:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 155 00000100:00100000:2.0:1789478523.538961:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+14:12187:x1876403945543168:12345-192.168.206.11@tcp:101:lctl.0 00010000:00010000:2.0:1789478523.538985:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478523.539006:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e82167f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b749f expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478523.539067:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216800 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478523.539107:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216800 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478523.539122:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216800 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478523.539163:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789478523.539167:0:10096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789478523.539187:0:10096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216800 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478523.539210:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e82167f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b749f expref: 16 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478523.539226:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216800 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b749f expref: 15 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478523.539235:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc1046f900) 00010000:00010000:2.0:1789478523.539238:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789478523.539241:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76600, rc 0) 00000100:00100000:2.0:1789478523.539306:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+15:12187:x1876403945543168:12345-192.168.206.11@tcp:101:lctl.0 Request processed in 347us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478523.539313:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 155 00000100:00100000:2.0:1789478523.576219:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478523.576345:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945543296 00000100:00100000:3.0:1789478523.576354:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945543296 00000100:00100000:3.0:1789478523.576428:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 156 00000100:00100000:3.0:1789478523.576438:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+15:12193:x1876403945543296:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:3.0:1789478523.576458:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478523.576476:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216807 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b74a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576532:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821680e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576545:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821680e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576555:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821680e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576566:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216815 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576573:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216815 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576633:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216815 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576704:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e821681c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576712:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e821681c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576719:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e821681c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478523.576748:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789478523.576752:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789478523.576782:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e821681c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576794:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821680e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576800:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821680e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576805:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821680e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576810:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478523.576813:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821680e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576819:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821680e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576838:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc1046f900) 00010000:00010000:3.0:1789478523.576840:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478523.576845:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821680e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576850:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e821680e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576862:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216815 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576869:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216815 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576874:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216815 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576879:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478523.576882:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216815 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576888:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216815 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576896:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ebc1046ff00) 00010000:00010000:3.0:1789478523.576898:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478523.576901:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216815 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576907:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216815 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576945:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216807 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74a6 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576957:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e821681c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74a6 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.576964:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:3.0:1789478523.576966:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789478523.576968:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fc400, rc 0) 00000100:00100000:3.0:1789478523.577018:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+16:12193:x1876403945543296:12345-192.168.206.11@tcp:101:bash.0 Request processed in 581us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478523.577025:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 156 00000100:00100000:1.0:1789478523.580483:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478523.581392:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945543552 00000100:00100000:3.0:1789478523.581402:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945543552 00000100:00100000:3.0:1789478523.581464:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 157 00000100:00100000:3.0:1789478523.581474:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+16:12193:x1876403945543552:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:3.0:1789478523.581491:0:13638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478523.581509:0:13638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216823 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b74ad expref: -99 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.581627:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e821682a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.581640:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e821682a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.581648:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e821682a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.581732:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216831 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.581740:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216831 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.581747:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216831 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789478523.582342:0:13638:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1789478523.582947:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e8216838 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.582960:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e8216838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.582968:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e8216838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.582995:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e821682a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.583002:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e821682a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.583009:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e821682a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.583014:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fca00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478523.583018:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e821682a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.583038:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e821682a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.583049:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:3.0:1789478523.583052:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478523.583056:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e821682a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.583062:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e821682a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789478523.583075:0:13638:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b14d40f reply state 00000000bfdebe41 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216831 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.583085:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216831 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.583091:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ebb02275800) 00010000:00010000:3.0:1789478523.583093:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789478523.583108:0:13638:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789478523.583138:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216823 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74ad expref: 19 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.583152:0:13638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e8216838 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74ad expref: 18 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.583159:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275700) 00010000:00010000:3.0:1789478523.583162:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789478523.583164:0:13638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b67a00, rc 0) 00000100:00100000:3.0:1789478523.583229:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+19:12193:x1876403945543552:12345-192.168.206.11@tcp:101:bash.0 Request processed in 1756us (2752us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1789478523.583237:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 157 00000100:00100000:1.0:1789478523.586401:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478523.586543:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945543680 00000100:00100000:2.0:1789478523.586553:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945543680 00000100:00100000:2.0:1789478523.586663:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 55 00000100:00100000:2.0:1789478523.586673:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945543680:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:2.0:1789478523.586705:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478523.586724:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216846 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b74b4 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789478523.586747:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789478523.586766:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=352s v=(0 0) 00010000:00010000:2.0:1789478523.586770:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478523.586779:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216846 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74b4 expref: 6 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478523.587078:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216846 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74b4 expref: 6 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478523.587091:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76e00, rc 0) 00000100:00080000:1.0:1789478523.587188:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789478523.587224:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2395:x1876403945543680:12345-192.168.206.11@tcp:101:bash.0 Request processed in 552us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478523.587231:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 55 00000100:00100000:2.0:1789478523.590848:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478523.590932:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945543808 00000100:00100000:0.0:1789478523.590940:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945543808 00000100:00100000:0.0:1789478523.590995:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 56 00000100:00100000:0.0:1789478523.591004:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:12193:x1876403945543808:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:0.0:1789478523.591027:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478523.591043:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006bdd1f0/0x8ebaae74e821684d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b74bb expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.591071:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216846 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74b4 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.591080:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478523.591084:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478523.591089:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006bdd1f0/0x8ebaae74e821684d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74bb expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.591132:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216846 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74b4 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.591174:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216846 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74b4 expref: 7 pid: 8431 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478523.591188:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f88a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1876403964478080:192.168.206.11@tcp:104: 00000100:00100000:0.0:1789478523.591263:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc359b69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478523.594919:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478523.595035:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945543936 00000100:00100000:1.0:1789478523.595042:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945543936 00010000:00010000:1.0:1789478523.595071:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216846 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74b4 expref: 8 pid: 8431 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478523.595118:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 80 00000100:00100000:1.0:1789478523.595128:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2396:x1876403945543936:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789478523.595142:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478523.595355:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216846 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74b4 expref: 8 pid: 8431 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478523.595369:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216846 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74b4 expref: 8 pid: 8431 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478523.595406:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478523.595411:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478523.595491:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000006bdd1f0/0x8ebaae74e821684d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74bb expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478523.595501:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006bdd1f0/0x8ebaae74e821684d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74bb expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478523.595537:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000006bdd1f0/0x8ebaae74e821684d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74bb expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478523.595549:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e99880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6503:1876403964478208:192.168.206.11@tcp:105: 00010000:00010000:0.0:1789478523.595723:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8216846 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74b4 expref: 8 pid: 8431 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478523.595738:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f88a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1876403964478080:192.168.206.11@tcp:104: 00010000:00010000:0.0:1789478523.595760:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000006bdd1f0/0x8ebaae74e821684d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74bb expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.595771:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029dee00, rc 0) 00000100:00100000:0.0:1789478523.595850:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:12193:x1876403945543808:12345-192.168.206.11@tcp:101:bash.0 Request processed in 4846us (5009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478523.595857:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 56 00000100:00100000:1.0:1789478523.595858:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0360e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478523.599712:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e99880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6503:1876403964478208:192.168.206.11@tcp:105: 00010000:00010000:0.0:1789478523.599735:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478523.599791:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2396:x1876403945543936:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 4663us (4879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478523.599802:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 80 00000100:00100000:2.0:1789478523.604766:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478523.605019:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945544192 00000100:00100000:0.0:1789478523.605029:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945544192 00000100:00100000:0.0:1789478523.605161:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 36 00000100:00100000:0.0:1789478523.605172:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+19:12193:x1876403945544192:12345-192.168.206.11@tcp:35:bash.0 00000100:00100000:0.0:1789478523.605456:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+20:12193:x1876403945544192:12345-192.168.206.11@tcp:35:bash.0 Request processed in 285us (696us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1789478523.605462:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 36 00000100:00100000:3.0:1789478523.683431:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478523.683945:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945544448 00000100:00100000:0.0:1789478523.683956:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945544448 00000100:00100000:1.0:1789478523.684139:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 158 00000100:00100000:1.0:1789478523.684150:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+20:12203:x1876403945544448:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1789478523.684172:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478523.684201:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216854 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b74c2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478523.684305:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789478523.684397:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216854 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74c2 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478523.684411:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc1046f900) 00010000:00010000:1.0:1789478523.684425:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789478523.684430:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216854 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74c2 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478523.684444:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4b200, rc 0) 00000100:00100000:1.0:1789478523.684503:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+21:12203:x1876403945544448:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 355us (1080us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1789478523.684510:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 158 00000100:00100000:2.0:1789478523.687932:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478523.688021:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945544704 00000100:00100000:1.0:1789478523.688030:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945544704 00000100:00100000:1.0:1789478523.688078:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 37 00000100:00100000:1.0:1789478523.688088:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+21:12203:x1876403945544704:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:1.0:1789478523.688915:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+22:12203:x1876403945544704:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 823us (985us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1789478523.688924:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 37 00000100:00100000:2.0:1789478523.780174:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478523.781055:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945544832 00000100:00100000:0.0:1789478523.781065:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945544832 00000100:00100000:0.0:1789478523.781564:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 159 00000100:00100000:0.0:1789478523.781575:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+22:12209:x1876403945544832:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1789478523.781630:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478523.781648:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e8216862 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b74c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.781704:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216869 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.781716:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216869 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.781726:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216869 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789478523.781761:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789478523.781764:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789478523.781780:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216869 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.781803:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e8216862 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74c9 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.781835:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216869 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74c9 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.781992:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:0.0:1789478523.781996:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789478523.782000:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029df800, rc 0) 00000100:00100000:0.0:1789478523.782221:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+23:12209:x1876403945544832:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 648us (2054us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478523.782229:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 159 00000100:00100000:3.0:1789478523.785027:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478523.785116:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945545088 00000100:00100000:0.0:1789478523.785126:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945545088 00000100:00100000:0.0:1789478523.785187:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 160 00000100:00100000:0.0:1789478523.785196:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34c98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+23:12209:x1876403945545088:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1789478523.785214:0:13638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478523.785230:0:13638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df600/0x8ebaae74e8216870 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b74d0 expref: -99 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.785338:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216877 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.785353:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216877 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.785363:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216877 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789478523.785374:0:13638:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789478523.785719:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df600/0x8ebaae74e8216870 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74d0 expref: 26 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.785736:0:13638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216877 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74d0 expref: 25 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.785742:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275700) 00010000:00010000:0.0:1789478523.785744:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789478523.785746:0:13638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029df400, rc 0) 00000100:00100000:0.0:1789478523.785913:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34c98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+25:12209:x1876403945545088:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 717us (893us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1789478523.785920:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 160 00000100:00100000:1.0:1789478523.790504:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478523.790557:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478523.790757:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945545472 00000100:00100000:0.0:1789478523.790767:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945545472 00000100:00100000:0.0:1789478523.790833:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:0.0:1789478523.790843:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+25:2395:x1876403945545472:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478523.790857:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478523.790880:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216877 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74d0 expref: 25 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.790898:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275700) 00010000:00010000:0.0:1789478523.790903:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478523.790957:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+24:2395:x1876403945545472:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 115us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478523.790965:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:3.0:1789478523.791028:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945545344 00000100:00100000:3.0:1789478523.791032:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945545344 00000100:00100000:3.0:1789478523.791069:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 161 00000100:00100000:3.0:1789478523.791076:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+24:12209:x1876403945545344:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1789478523.791095:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478523.791108:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216885 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b74d7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.791193:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821688c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.791205:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821688c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.791216:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821688c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478523.791228:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789478523.791327:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216885 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74d7 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.791341:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821688c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74d7 expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.791365:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275700) 00010000:00010000:3.0:1789478523.791368:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789478523.791370:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fd800, rc 0) 00000100:00100000:3.0:1789478523.791392:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+26:12209:x1876403945545344:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 317us (897us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1789478523.791398:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 161 00000100:00100000:2.0:1789478523.799499:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478523.799621:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945545600 00000100:00100000:0.0:1789478523.799630:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945545600 00000100:00100000:0.0:1789478523.799688:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:0.0:1789478523.799698:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0373d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2395:x1876403945545600:12345-192.168.206.11@tcp:1:lfs.0 00010000:00010000:0.0:1789478523.799735:0:8829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce5e813/0x8ebaae74e821689a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.799754:0:8829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000006bdd1f0/0x8ebaae74e821684d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74bb expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.799763:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478523.799767:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789478523.799771:0:8829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce5e813/0x8ebaae74e821689a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.799810:0:8829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000006bdd1f0/0x8ebaae74e821684d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74bb expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.799823:0:8829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000006bdd1f0/0x8ebaae74e821684d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74bb expref: 6 pid: 8430 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478523.799836:0:8829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f88a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8829:1876403964478336:192.168.206.11@tcp:104: 00000100:00100000:0.0:1789478523.799899:0:8829:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc359b6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789478523.802212:0:8829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f88a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8829:1876403964478336:192.168.206.11@tcp:104: 00010000:00010000:0.0:1789478523.802237:0:8829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ce5e813/0x8ebaae74e821689a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478523.803086:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478523.803368:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945545728 00000100:00100000:1.0:1789478523.803375:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945545728 00002000:00100000:1.0:1789478523.803422:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8ebb0373f800 x1876403945545728/t0(0) o4->327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp:184/0 lens 504/0 e 0 to 0 dl 1789478534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789478523.803433:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ebb0373f800 with x1876403945545728 ext(0->12) 00010000:00010000:1.0:1789478523.803441:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000006bdd1f0/0x8ebaae74e821684d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74bb expref: 7 pid: 8430 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478523.803455:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000006bdd1f0/0x8ebaae74e821684d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74bb expref: 7 pid: 8430 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789478523.803479:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ebb0373f800 00000100:00100000:1.0:1789478523.803508:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 2 00000100:00100000:1.0:1789478523.803516:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0373f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2396:x1876403945545728:12345-192.168.206.11@tcp:4:lfs.0 00000100:00100000:1.0:1789478523.806044:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0373f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:2396:x1876403945545728:12345-192.168.206.11@tcp:4:lfs.0 Request processed in 2519us (2951us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789478523.806056:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 2 00002000:00100000:1.0:1789478523.806068:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8ebb0373f800 x1876403945545728/t4294967306(0) o4->327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp:184/0 lens 504/448 e 0 to 0 dl 1789478534 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789478523.806078:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ebb0373f800 with x1876403945545728 ext(0->12) 00010000:00010000:1.0:1789478523.806087:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000006bdd1f0/0x8ebaae74e821684d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74bb expref: 9 pid: 8430 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478523.806105:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000006bdd1f0/0x8ebaae74e821684d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74bb expref: 9 pid: 8430 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789478523.806113:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ebb0373f800 00000100:00100000:1.0:1789478523.823147:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478523.825054:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945545856 00000100:00100000:3.0:1789478523.825067:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945545856 00010000:00010000:3.0:1789478523.825111:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000006bdd1f0/0x8ebaae74e821684d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74bb expref: 9 pid: 8430 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478523.825199:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 81 00000100:00100000:3.0:1789478523.825209:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:2396:x1876403945545856:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789478523.825222:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789478523.825238:0:6502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789478523.825241:0:6502:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789478523 00002000:00010000:3.0:1789478523.825243:0:6502:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789478523 00002000:00010000:3.0:1789478523.825245:0:6502:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789478523 00002000:00010000:3.0:1789478523.825247:0:6502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789478523.825252:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000006bdd1f0/0x8ebaae74e821684d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74bb expref: 9 pid: 8430 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.825265:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000006bdd1f0/0x8ebaae74e821684d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74bb expref: 9 pid: 8430 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.825319:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006bdd1f0/0x8ebaae74e821684d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74bb expref: 9 pid: 8430 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.825334:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789478523.825338:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789478523.825343:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ce5e813/0x8ebaae74e821689a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.825351:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce5e813/0x8ebaae74e821689a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.825386:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478523.825443:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2396:x1876403945545856:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 234us (2303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478523.825451:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 81 00010000:00010000:1.0:1789478523.825467:0:8829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ce5e813/0x8ebaae74e821689a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478523.825480:0:8829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce5e813/0x8ebaae74e821689a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478523.825500:0:8829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce5e813/0x8ebaae74e821689a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478523.825515:0:8829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce5e813/0x8ebaae74e821689a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478523.825523:0:8829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce5e813/0x8ebaae74e821689a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478523.825530:0:8829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029df600 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:1.0:1789478523.825534:0:8829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce5e813/0x8ebaae74e821689a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478523.825542:0:8829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce5e813/0x8ebaae74e821689a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478523.825554:0:8829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce5e813/0x8ebaae74e821689a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478523.825562:0:8829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce5e813/0x8ebaae74e821689a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478523.825632:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0373d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2395:x1876403945545600:12345-192.168.206.11@tcp:1:lfs.0 Request processed in 25935us (26140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478523.825641:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:2.0:1789478523.828154:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478523.831732:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945546112 00000100:00100000:0.0:1789478523.831900:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945546112 00000100:00100000:0.0:1789478523.832009:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 38 00000100:00100000:0.0:1789478523.832020:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc0838e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+26:12209:x1876403945546112:12345-192.168.206.11@tcp:35:lfs.0 00000004:00010000:0.0:1789478523.832091:0:6520:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821688c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74d7 expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789478523.833825:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1789478523.833868:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1789478523.834470:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1789478523.834509:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168a1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.834528:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e8216838 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74ad expref: 30 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.834537:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168a1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.834571:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e8216838 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74ad expref: 30 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.834586:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e8216838 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74ad expref: 30 pid: 13638 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478523.835382:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f88a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6520:1876403964478464:192.168.206.11@tcp:104: 00000100:00100000:0.0:1789478523.835523:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc359b6780 going to sleep for 11 seconds 00000100:00100000:1.0:1789478523.848685:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478523.848877:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f88a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6520:1876403964478464:192.168.206.11@tcp:104: 00010000:00010000:0.0:1789478523.848903:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168a1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478523.849507:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945546240 00000100:00100000:2.0:1789478523.849515:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945546240 00010000:00010000:2.0:1789478523.849557:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e8216838 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74ad expref: 31 pid: 13638 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478523.849621:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 82 00000100:00100000:2.0:1789478523.849632:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+31:2396:x1876403945546240:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789478523.849646:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478523.849652:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e8216838 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74ad expref: 31 pid: 13638 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478523.849663:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e8216838 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74ad expref: 31 pid: 13638 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478523.849683:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e8216838 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74ad expref: 31 pid: 13638 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478523.849697:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275700) 00010000:00010000:2.0:1789478523.849702:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168a1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478523.849710:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478523.849716:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168a1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478523.849736:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478523.849792:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+30:2396:x1876403945546240:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 162us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478523.849800:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 82 00010000:00010000:1.0:1789478523.850635:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478523.850664:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789478523.850757:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1789478523.850871:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1789478523.850974:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c5bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1876403964478592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789478523.851032:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478523.851310:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0360ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478523.851815:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964478592 00000100:00100000:2.0:1789478523.851823:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964478592 00000100:00100000:2.0:1789478523.851920:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789478523.851930:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1876403964478592:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789478523.852044:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1876403964478592:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 116us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478523.852051:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789478523.852112:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c5bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1876403964478592:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789478523.852227:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1789478523.852287:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c94ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1876403964478720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789478523.852314:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478523.853749:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0360ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1789478523.853955:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964478720 00000100:00100000:0.0:1789478523.853963:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964478720 00000100:00100000:0.0:1789478523.854012:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789478523.854021:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c94f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6520:x1876403964478720:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789478523.854799:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c94f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6520:x1876403964478720:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 776us (2480us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789478523.854807:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789478523.855010:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c94ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1876403964478720:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789478523.855080:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1789478523.855117:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478523.855127:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168a1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478523.855134:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168a1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478523.855140:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029df400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478523.855144:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168a1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478523.855167:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168a1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478523.855181:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275700) 00010000:00010000:1.0:1789478523.855379:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789478523.855385:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168a1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478523.855391:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168a1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789478523.855499:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789478523.855551:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1789478523.855562:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352970967483ns, next at 353970964881ns, rc = 0 00000001:00080000:1.0:1789478523.855568:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1789478523.855589:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275700) 00010000:00010000:1.0:1789478523.855632:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789478523.855639:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e821688c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74d7 expref: 34 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478523.855726:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc0838e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+33:12209:x1876403945546112:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 23709us (27580us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1789478523.855734:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 38 00000020:00080000:1.0:1789478523.855738:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789478523.868180:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478523.868366:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945546368 00000100:00100000:3.0:1789478523.868375:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945546368 00000100:00100000:3.0:1789478523.868433:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 162 00000100:00100000:3.0:1789478523.868443:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0373ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+33:12209:x1876403945546368:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1789478523.868465:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478523.868495:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e82168a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b74de expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.868548:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e82168a8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74de expref: 34 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.868580:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e82168a8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74de expref: 34 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.868625:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:3.0:1789478523.868629:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789478523.868632:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fca00, rc 0) 00000100:00100000:3.0:1789478523.869571:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0373ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+34:12209:x1876403945546368:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 1124us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478523.869581:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 162 00000100:00100000:1.0:1789478523.879430:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478523.880337:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945546624 00000100:00100000:2.0:1789478523.880346:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945546624 00000100:00100000:0.0:1789478523.880477:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 39 00000100:00100000:0.0:1789478523.880495:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+34:12209:x1876403945546624:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:0.0:1789478523.880692:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+35:12209:x1876403945546624:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 199us (1270us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1789478523.880700:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 39 00000100:00100000:0.0:1789478523.974001:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478523.974081:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945546880 00000100:00100000:3.0:1789478523.974090:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945546880 00000100:00100000:3.0:1789478523.974139:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 163 00000100:00100000:3.0:1789478523.974148:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+35:12219:x1876403945546880:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1789478523.974167:0:13638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478523.974184:0:13638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82168af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b74e5 expref: -99 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478523.974264:0:13638:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789478523.974355:0:13638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82168af lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74e5 expref: 37 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.974369:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc1046f900) 00010000:00010000:3.0:1789478523.974372:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789478523.974377:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82168af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74e5 expref: 37 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478523.974406:0:13638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fce00, rc 0) 00000100:00100000:3.0:1789478523.974785:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+36:12219:x1876403945546880:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 630us (783us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1789478523.974793:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 163 00000100:00100000:2.0:1789478523.982181:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478523.982244:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945547008 00000100:00100000:0.0:1789478523.982254:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945547008 00000100:00100000:0.0:1789478523.982328:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 164 00000100:00100000:0.0:1789478523.982338:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0373e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+36:12219:x1876403945547008:12345-192.168.206.11@tcp:34:lfs.0 00010000:00010000:0.0:1789478523.982405:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e82168bd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982421:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e82168bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982432:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e82168bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982460:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e82168c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982469:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e82168c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982475:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e82168c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982544:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982551:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982558:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789478523.982639:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982652:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e82168bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982658:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e82168bd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982665:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e82168bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982671:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029dfa00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478523.982674:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e82168bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982688:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e82168bd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982700:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:0.0:1789478523.982703:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478523.982707:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e82168bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982713:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e82168bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982725:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e82168c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982730:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e82168c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982735:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e82168c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982740:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029de400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478523.982743:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e82168c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982749:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e82168c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982755:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ebb02275800) 00010000:00010000:0.0:1789478523.982758:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478523.982761:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e82168c4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982775:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e82168c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982786:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982793:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982798:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982802:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029df400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478523.982805:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982810:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982817:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:0.0:1789478523.982819:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478523.982822:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478523.982827:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e82168cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478523.982906:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0373e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+36:12219:x1876403945547008:12345-192.168.206.11@tcp:34:lfs.0 Request processed in 569us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478523.982913:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 164 00000100:00100000:0.0:1789478523.988558:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478523.988724:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945547264 00000100:00100000:1.0:1789478523.988733:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945547264 00000100:00100000:1.0:1789478523.988800:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 40 00000100:00100000:1.0:1789478523.988810:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+36:12219:x1876403945547264:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:1.0:1789478523.989034:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+37:12219:x1876403945547264:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 225us (483us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1789478523.989041:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 40 00000100:00100000:3.0:1789478524.044726:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478524.044887:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945547520 00000100:00100000:2.0:1789478524.044902:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945547520 00000100:00100000:2.0:1789478524.044960:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 165 00000100:00080000:1.0:1789478524.044963:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789478524.044971:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3fcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+37:12222:x1876403945547520:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:2.0:1789478524.044993:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478524.045010:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e82168d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b74ec expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045070:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82168d9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045083:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82168d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045093:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82168d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045103:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82168e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045122:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82168e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045129:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82168e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045215:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82168e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045224:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82168e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045231:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82168e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478524.045239:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789478524.045308:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82168d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045316:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82168d9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045323:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82168d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045328:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76000 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478524.045332:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82168d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045339:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82168d9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045421:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:2.0:1789478524.045424:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478524.045428:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82168d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045435:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82168d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045447:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82168e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045453:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82168e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045459:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82168e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045464:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77e00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478524.045467:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82168e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045473:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82168e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045479:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ebb02275800) 00010000:00010000:2.0:1789478524.045481:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478524.045483:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82168e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045489:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82168e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045526:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e82168d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74ec expref: 40 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045538:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82168e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74ec expref: 39 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478524.045546:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:2.0:1789478524.045548:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789478524.045551:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76e00, rc 0) 00000100:00100000:2.0:1789478524.046033:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3fcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+39:12222:x1876403945547520:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 1061us (1313us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789478524.046042:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 165 00000100:00100000:2.0:1789478524.057815:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478524.058028:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945547648 00000100:00100000:3.0:1789478524.058038:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945547648 00000100:00100000:3.0:1789478524.058103:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 166 00000100:00100000:3.0:1789478524.058113:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0373ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+39:12222:x1876403945547648:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:3.0:1789478524.058183:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82168f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.058199:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82168f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.058211:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82168f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.058242:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82168f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.058250:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82168f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.058256:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82168f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.058261:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fce00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478524.058288:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82168f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.058296:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82168f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.058308:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:3.0:1789478524.058310:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789478524.058314:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82168f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.058321:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82168f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478524.058394:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0373ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+39:12222:x1876403945547648:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 282us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478524.058401:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 166 00000100:00100000:0.0:1789478524.060031:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478524.060093:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945547904 00000100:00100000:1.0:1789478524.060101:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945547904 00000100:00100000:1.0:1789478524.060148:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 41 00000100:00100000:1.0:1789478524.060157:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+39:12222:x1876403945547904:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:1.0:1789478524.060371:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+40:12222:x1876403945547904:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 214us (345us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1789478524.060379:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 41 00000100:00100000:1.0:1789478524.308791:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478524.308938:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945548160 00000100:00100000:3.0:1789478524.308947:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945548160 00000100:00100000:3.0:1789478524.309009:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 167 00000100:00100000:3.0:1789478524.309019:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+40:12253:x1876403945548160:12345-192.168.206.11@tcp:101:cat.0 00010000:00010000:3.0:1789478524.309046:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478524.309066:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82168fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b74f3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.309178:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216903 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.309192:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216903 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.309222:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216903 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478524.309234:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789478524.309486:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e82168fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74f3 expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.309505:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216903 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74f3 expref: 42 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.309514:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:3.0:1789478524.309517:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789478524.309520:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fd600, rc 0) 00000100:00100000:3.0:1789478524.309577:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+42:12253:x1876403945548160:12345-192.168.206.11@tcp:101:cat.0 Request processed in 560us (804us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1789478524.309585:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 167 00000100:00100000:2.0:1789478524.313350:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478524.313448:0:10392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945548288 00000100:00100000:0.0:1789478524.313457:0:10392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945548288 00000100:00100000:0.0:1789478524.313518:0:10392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 13 00000100:00100000:0.0:1789478524.313528:0:10392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0373ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+42:2396:x1876403945548288:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478524.313542:0:10392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478524.313564:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216903 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74f3 expref: 42 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478524.313583:0:10392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:0.0:1789478524.313588:0:10392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478524.313760:0:10392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0373ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+41:2396:x1876403945548288:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 234us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478524.313768:0:10392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 13 00000100:00100000:0.0:1789478524.320924:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478524.321010:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945548544 00000100:00100000:1.0:1789478524.321019:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945548544 00000100:00100000:1.0:1789478524.321070:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 42 00000100:00100000:1.0:1789478524.321081:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+41:12253:x1876403945548544:12345-192.168.206.11@tcp:35:cat.0 00000100:00100000:1.0:1789478524.321717:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+42:12253:x1876403945548544:12345-192.168.206.11@tcp:35:cat.0 Request processed in 634us (798us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1789478524.321726:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 42 00000100:00100000:1.0:1789478524.413808:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478524.413901:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945548800 00000100:00100000:3.0:1789478524.413909:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945548800 00000100:00100000:3.0:1789478524.413978:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 168 00000100:00100000:3.0:1789478524.413989:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+42:12259:x1876403945548800:12345-192.168.206.11@tcp:101:dd.0 00010000:00010000:3.0:1789478524.414010:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478524.414014:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789478524.414037:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216869 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74c9 expref: 42 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.414056:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:3.0:1789478524.414072:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789478524.414085:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216911 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b74fa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.414178:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216918 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.414191:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82168e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74ec expref: 42 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.414200:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216918 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.414230:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82168e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74ec expref: 42 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.414243:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82168e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74ec expref: 42 pid: 10096 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478524.414256:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3fca8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964478848:192.168.206.11@tcp:104: 00000100:00100000:3.0:1789478524.414352:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03cd7600 going to sleep for 11 seconds 00000100:00100000:2.0:1789478524.417866:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478524.417974:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945548928 00000100:00100000:0.0:1789478524.417984:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945548928 00010000:00010000:0.0:1789478524.418022:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82168e7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74ec expref: 43 pid: 10096 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478524.418062:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 83 00000100:00100000:0.0:1789478524.418072:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08342850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+43:2396:x1876403945548928:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478524.418085:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478524.418091:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82168e7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74ec expref: 43 pid: 10096 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478524.418132:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82168e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74ec expref: 43 pid: 10096 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478524.418153:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:0.0:1789478524.418159:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216918 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478524.418168:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216918 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478524.418175:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216918 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478524.418192:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478524.418247:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08342850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+43:2396:x1876403945548928:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 176us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478524.418254:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 83 00010000:00010000:3.0:1789478524.420036:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82168e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74ec expref: 42 pid: 10096 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478524.420058:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3fca8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964478848:192.168.206.11@tcp:104: 00010000:00010000:3.0:1789478524.420078:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216918 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.420087:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216918 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.420117:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216918 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478524.420135:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789478524.420253:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216911 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74fa expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.420268:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216918 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74fa expref: 42 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.420289:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:3.0:1789478524.420522:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789478524.420527:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fd400, rc 0) 00000100:00100000:3.0:1789478524.420786:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+42:12259:x1876403945548800:12345-192.168.206.11@tcp:101:dd.0 Request processed in 6798us (6985us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1789478524.420795:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 168 00000100:00100000:2.0:1789478524.448975:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478524.449072:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945549056 00000100:00100000:0.0:1789478524.449081:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945549056 00000100:00100000:0.0:1789478524.449135:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 169 00000100:00100000:0.0:1789478524.449145:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0373c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+42:12259:x1876403945549056:12345-192.168.206.11@tcp:101:dd.0 00010000:00010000:0.0:1789478524.449167:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478524.449184:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e8216926 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7501 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478524.449215:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e821692d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478524.449242:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e821692d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478524.449252:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e821692d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478524.449369:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e8216926 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7501 expref: 44 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478524.449387:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e821692d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7501 expref: 43 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478524.449396:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:0.0:1789478524.449400:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789478524.449404:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029dee00, rc 0) 00000100:00100000:0.0:1789478524.449462:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0373c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+43:12259:x1876403945549056:12345-192.168.206.11@tcp:101:dd.0 Request processed in 319us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478524.449469:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 169 00010000:00010000:2.0:1789478524.453181:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478524.461155:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478524.461487:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945549312 00000100:00100000:3.0:1789478524.461496:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945549312 00000100:00100000:3.0:1789478524.461550:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 170 00000100:00100000:3.0:1789478524.461559:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+43:12259:x1876403945549312:12345-192.168.206.11@tcp:36:dd.0 00010000:00010000:3.0:1789478524.461809:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216934 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.461825:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216934 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.461837:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216934 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789478524.462174:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:3.0:1789478524.462199:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005160820 reply state 000000009aae23a2 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216934 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.462212:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216934 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.462219:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:3.0:1789478524.462222:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789478524.462225:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789478524.464269:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+46:12259:x1876403945549312:12345-192.168.206.11@tcp:36:dd.0 Request processed in 2702us (3114us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1789478524.464291:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 170 00000020:00080000:3.0:1789478524.464307:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789478524.893758:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478524.893859:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945549440 00000100:00100000:1.0:1789478524.893869:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945549440 00000100:00100000:1.0:1789478524.893945:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 171 00000100:00100000:1.0:1789478524.893955:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3fca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+46:12273:x1876403945549440:12345-192.168.206.11@tcp:101:stat.0 00010000:00010000:1.0:1789478524.893976:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478524.894007:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ba00/0x8ebaae74e821693b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7508 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.894066:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216942 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.894079:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216942 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.894091:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216942 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.894102:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4bc00/0x8ebaae74e8216949 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.894109:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4bc00/0x8ebaae74e8216949 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.894115:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4bc00/0x8ebaae74e8216949 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.894178:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216950 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.894189:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216918 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74fa expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.894197:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216950 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.894227:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216918 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74fa expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.894251:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216918 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74fa expref: 47 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478524.894265:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964478976:192.168.206.11@tcp:104: 00000100:00100000:1.0:1789478524.894569:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0360e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789478524.899056:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478524.900030:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964478976:192.168.206.11@tcp:104: 00010000:00010000:1.0:1789478524.900056:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216950 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478524.900133:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945549696 00000100:00100000:2.0:1789478524.900140:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945549696 00000100:00100000:2.0:1789478524.900193:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 43 00000100:00100000:2.0:1789478524.900203:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+48:6162:x1876403945549696:12345-192.168.206.11@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789478524.900712:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+49:6162:x1876403945549696:12345-192.168.206.11@tcp:35:ldlm_bl.0 Request processed in 509us (1663us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1789478524.900721:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 43 00000100:00100000:2.0:1789478524.903672:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478524.903843:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945549824 00000100:00100000:0.0:1789478524.903852:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945549824 00010000:00010000:0.0:1789478524.903948:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216918 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74fa expref: 49 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478524.904024:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 84 00000100:00100000:0.0:1789478524.904035:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0373e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+49:2395:x1876403945549824:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478524.904057:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478524.904064:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216918 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74fa expref: 49 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478524.904077:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216918 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74fa expref: 49 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478524.904286:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216918 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74fa expref: 49 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478524.904303:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:0.0:1789478524.904308:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216950 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478524.904318:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216950 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478524.904325:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216950 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478524.904398:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478524.904458:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0373e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+48:2395:x1876403945549824:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 425us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478524.904466:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 84 00010000:00010000:1.0:1789478524.905857:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216950 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.905869:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216950 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478524.905971:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789478524.905974:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789478524.905996:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216950 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.906009:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216950 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.906017:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216942 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.906024:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216942 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.906044:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216942 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.906050:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4a800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478524.906053:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216942 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.906060:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216942 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.906072:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:1.0:1789478524.906075:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478524.906079:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216942 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.906085:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216942 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.906304:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4bc00/0x8ebaae74e8216949 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.906311:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4bc00/0x8ebaae74e8216949 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.906318:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4bc00/0x8ebaae74e8216949 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.906323:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4bc00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478524.906326:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4bc00/0x8ebaae74e8216949 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.906341:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4bc00/0x8ebaae74e8216949 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.906350:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ebb02275800) 00010000:00010000:1.0:1789478524.906352:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478524.906355:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4bc00/0x8ebaae74e8216949 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.906361:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4bc00/0x8ebaae74e8216949 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.906397:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ba00/0x8ebaae74e821693b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7508 expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.906411:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216950 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7508 expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478524.906418:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:1.0:1789478524.906420:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789478524.906422:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4a600, rc 0) 00000100:00100000:1.0:1789478524.906484:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3fca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+47:12273:x1876403945549440:12345-192.168.206.11@tcp:101:stat.0 Request processed in 12530us (12734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478524.906491:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 171 00000100:00100000:2.0:1789478524.952427:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478524.952520:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945550080 00000100:00100000:3.0:1789478524.952529:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945550080 00000100:00100000:3.0:1789478524.952583:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 172 00000100:00100000:3.0:1789478524.952623:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0373c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+47:12279:x1876403945550080:12345-192.168.206.11@tcp:36:truncate.0 00010000:00010000:3.0:1789478524.952674:0:10096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478524.952700:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216950 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7508 expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.952717:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:3.0:1789478524.952723:0:10096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789478524.952873:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216957 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.952903:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216957 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.952926:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216957 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789478524.952969:0:10096:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1789478524.952988:0:10096:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc677adc reply state 00000000989b3204 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216957 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.952999:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216957 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478524.953006:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:3.0:1789478524.953008:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789478524.953011:0:10096:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789478524.953096:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0373c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+49:12279:x1876403945550080:12345-192.168.206.11@tcp:36:truncate.0 Request processed in 504us (676us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1789478524.953104:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 172 00000020:00080000:3.0:1789478524.953108:0:10096:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789478525.061690:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478525.061862:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945550208 00000100:00100000:3.0:1789478525.061871:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945550208 00000100:00100000:3.0:1789478525.061931:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 173 00000100:00100000:3.0:1789478525.061942:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0373fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+49:12293:x1876403945550208:12345-192.168.206.11@tcp:101:stat.0 00010000:00010000:3.0:1789478525.061964:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478525.061983:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e821695e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b750f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062060:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216965 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062079:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216965 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062090:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216965 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062102:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e821696c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062110:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e821696c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062116:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e821696c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062177:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216973 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062186:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216973 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062193:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216973 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478525.062227:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1789478525.062232:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789478525.062248:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216973 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062260:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216973 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062292:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216965 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062299:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216965 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062306:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216965 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062311:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478525.062316:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216965 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062322:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216965 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062335:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:3.0:1789478525.062337:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478525.062342:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216965 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062349:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216965 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062360:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e821696c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062366:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e821696c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062385:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e821696c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062396:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67a00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478525.062399:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e821696c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062406:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e821696c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062415:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ebb02275800) 00010000:00010000:3.0:1789478525.062417:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478525.062420:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e821696c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062426:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e821696c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062451:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e821695e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b750f expref: 51 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062463:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216973 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b750f expref: 50 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.062470:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:3.0:1789478525.062473:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789478525.062475:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b67400, rc 0) 00000100:00100000:3.0:1789478525.062530:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0373fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+50:12293:x1876403945550208:12345-192.168.206.11@tcp:101:stat.0 Request processed in 589us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478525.062538:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 173 00000100:00100000:2.0:1789478525.124123:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478525.124304:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945550464 00000100:00100000:1.0:1789478525.124313:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945550464 00000100:00100000:1.0:1789478525.124391:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 174 00000100:00100000:1.0:1789478525.124401:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0373d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+50:12303:x1876403945550464:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1789478525.124435:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478525.124454:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ba00/0x8ebaae74e821697a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7516 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478525.124549:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789478525.124671:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ba00/0x8ebaae74e821697a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7516 expref: 52 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478525.124684:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc1046f900) 00010000:00010000:1.0:1789478525.124686:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789478525.124691:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ba00/0x8ebaae74e821697a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7516 expref: 52 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478525.124704:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4ba00, rc 0) 00000100:00100000:1.0:1789478525.124789:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0373d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+51:12303:x1876403945550464:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 387us (672us total) trans 4294967447 rc 301/301 00000100:00100000:1.0:1789478525.124796:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 174 00000100:00100000:2.0:1789478525.127372:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478525.127477:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945550720 00000100:00100000:1.0:1789478525.127486:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945550720 00000100:00100000:1.0:1789478525.127571:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 44 00000100:00100000:1.0:1789478525.127581:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc0838cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+51:12303:x1876403945550720:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:1.0:1789478525.127877:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc0838cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+52:12303:x1876403945550720:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 285us (500us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1789478525.127885:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 44 00000100:00100000:2.0:1789478525.164085:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478525.164156:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945550976 00000100:00100000:0.0:1789478525.164166:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945550976 00000100:00100000:0.0:1789478525.164224:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 175 00000100:00100000:0.0:1789478525.164235:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0373ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+52:12309:x1876403945550976:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:0.0:1789478525.164293:0:13638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478525.164311:0:13638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df200/0x8ebaae74e8216988 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b751d expref: -99 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478525.164407:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e821698f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478525.164422:0:13638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216973 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b750f expref: 53 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478525.164431:0:13638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e821698f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478525.164464:0:13638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216973 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b750f expref: 53 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478525.164477:0:13638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216973 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b750f expref: 53 pid: 6518 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478525.164490:0:13638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13638:1876403964479104:192.168.206.11@tcp:104: 00000100:00100000:0.0:1789478525.164580:0:13638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc359b6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789478525.166429:0:13638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13638:1876403964479104:192.168.206.11@tcp:104: 00010000:00010000:3.0:1789478525.166467:0:13638:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e821698f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478525.167135:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478525.168015:0:10392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945551104 00000100:00100000:0.0:1789478525.168024:0:10392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945551104 00010000:00010000:0.0:1789478525.168057:0:10392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216973 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b750f expref: 54 pid: 6518 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478525.168130:0:10392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 85 00000100:00100000:0.0:1789478525.168140:0:10392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0373d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+54:2395:x1876403945551104:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478525.168162:0:10392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478525.168169:0:10392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216973 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b750f expref: 54 pid: 6518 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478525.168182:0:10392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216973 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b750f expref: 54 pid: 6518 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478525.168202:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216973 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b750f expref: 54 pid: 6518 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478525.168217:0:10392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:0.0:1789478525.168222:0:10392:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e821698f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478525.168231:0:10392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e821698f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478525.168238:0:10392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e821698f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478525.168278:0:10392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478525.168329:0:10392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0373d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+53:2395:x1876403945551104:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 189us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478525.168336:0:10392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 85 00010000:00010000:1.0:1789478525.168382:0:13638:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e821698f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478525.168400:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e821698f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478525.168416:0:13638:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1789478525.168538:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df200/0x8ebaae74e8216988 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b751d expref: 54 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478525.168554:0:13638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e821698f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b751d expref: 53 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478525.168561:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:1.0:1789478525.168564:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789478525.168566:0:13638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029de800, rc 0) 00000100:00100000:1.0:1789478525.168650:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0373ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+53:12309:x1876403945550976:12345-192.168.206.11@tcp:101:bash.0 Request processed in 4359us (4515us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1789478525.168659:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 175 00000100:00100000:0.0:1789478525.172351:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478525.172424:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945551360 00000100:00100000:3.0:1789478525.172433:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945551360 00000100:00100000:3.0:1789478525.172497:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 176 00000100:00100000:3.0:1789478525.172515:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+53:12309:x1876403945551360:12345-192.168.206.11@tcp:36:bash.0 00010000:00010000:3.0:1789478525.172752:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e821699d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.172769:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e821699d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.172791:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e821699d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789478525.172830:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1789478525.172849:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8909d21 reply state 000000004476972b transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e821699d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.172861:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e821699d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.172868:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:3.0:1789478525.172876:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789478525.172879:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789478525.172960:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+56:12309:x1876403945551360:12345-192.168.206.11@tcp:36:bash.0 Request processed in 454us (616us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1789478525.172969:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 176 00000020:00080000:3.0:1789478525.172973:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789478525.181565:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478525.181699:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945551488 00000100:00100000:1.0:1789478525.181708:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945551488 00000100:00100000:1.0:1789478525.181859:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 177 00000100:00100000:1.0:1789478525.181877:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0373df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+56:12309:x1876403945551488:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:1.0:1789478525.181900:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478525.181927:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4bc00/0x8ebaae74e82169a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7524 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478525.182007:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e82169ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478525.182038:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e821698f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b751d expref: 57 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478525.182047:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e82169ab lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478525.182091:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e821698f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b751d expref: 57 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478525.182105:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e821698f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b751d expref: 57 pid: 13638 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478525.182118:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03c5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964479232:192.168.206.11@tcp:104: 00000100:00100000:1.0:1789478525.182197:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc3c8a69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478525.186469:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03c5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964479232:192.168.206.11@tcp:104: 00010000:00010000:3.0:1789478525.186496:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e82169ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478525.187826:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478525.187893:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945551616 00000100:00100000:0.0:1789478525.187900:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945551616 00010000:00010000:0.0:1789478525.187941:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e821698f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b751d expref: 58 pid: 13638 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478525.187980:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 86 00000100:00100000:0.0:1789478525.187986:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0373dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+58:2395:x1876403945551616:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478525.187996:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478525.188007:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e821698f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b751d expref: 58 pid: 13638 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478525.188020:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e821698f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b751d expref: 58 pid: 13638 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478525.188041:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e821698f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b751d expref: 58 pid: 13638 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478525.188065:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:0.0:1789478525.188082:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e82169ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478525.188091:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e82169ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478525.188098:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e82169ab lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478525.188120:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789478525.188133:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e82169ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.188143:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e82169ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478525.188170:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0373dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+57:2395:x1876403945551616:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 181us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478525.188187:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 86 00000004:00200000:3.0:1789478525.188192:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789478525.188197:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789478525.188215:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e82169ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.188244:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4bc00/0x8ebaae74e82169a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7524 expref: 57 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.188259:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e82169ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7524 expref: 56 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.188266:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:3.0:1789478525.188282:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789478525.188284:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4a800, rc 0) 00000100:00100000:3.0:1789478525.188311:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0373df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+56:12309:x1876403945551488:12345-192.168.206.11@tcp:101:bash.0 Request processed in 6444us (6974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478525.188319:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 177 00000100:00100000:1.0:1789478525.190329:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478525.190456:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945551872 00000100:00100000:2.0:1789478525.190465:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945551872 00000100:00100000:2.0:1789478525.190510:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 45 00000100:00100000:2.0:1789478525.190519:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+56:12309:x1876403945551872:12345-192.168.206.11@tcp:35:bash.0 00000100:00100000:2.0:1789478525.190910:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+57:12309:x1876403945551872:12345-192.168.206.11@tcp:35:bash.0 Request processed in 391us (586us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1789478525.190918:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 45 00000100:00100000:2.0:1789478525.257696:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478525.257849:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945552128 00000100:00100000:3.0:1789478525.257858:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945552128 00000100:00100000:3.0:1789478525.257960:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 178 00000100:00100000:3.0:1789478525.257984:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0373f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+57:12319:x1876403945552128:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1789478525.258006:0:13638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478525.258026:0:13638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82169b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b752b expref: -99 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478525.258129:0:13638:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789478525.258214:0:13638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82169b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b752b expref: 59 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.258227:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc1046f900) 00010000:00010000:3.0:1789478525.258230:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789478525.258234:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82169b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b752b expref: 59 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.258247:0:13638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b67400, rc 0) 00000100:00100000:3.0:1789478525.258319:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0373f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+58:12319:x1876403945552128:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 337us (642us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1789478525.258327:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 178 00000100:00100000:3.0:1789478525.260161:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478525.260241:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945552256 00000100:00100000:2.0:1789478525.260248:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945552256 00000100:00100000:2.0:1789478525.260302:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 179 00000100:00100000:2.0:1789478525.260313:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3fcabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+58:12319:x1876403945552256:12345-192.168.206.11@tcp:34:lfs.0 00010000:00010000:2.0:1789478525.260371:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e82169c0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260385:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e82169c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260395:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e82169c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260420:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82169c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260426:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82169c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260433:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82169c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260492:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82169ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260501:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82169ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260507:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82169ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789478525.260546:0:10096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82169ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260557:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e82169c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260563:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e82169c0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260569:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e82169c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260574:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478525.260577:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e82169c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260590:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e82169c0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260626:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:2.0:1789478525.260629:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478525.260634:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e82169c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260640:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e82169c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260653:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82169c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260659:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82169c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260664:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82169c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260668:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77e00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478525.260672:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82169c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260680:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82169c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260687:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ebb02275800) 00010000:00010000:2.0:1789478525.260690:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478525.260692:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82169c7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260706:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82169c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260715:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82169ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260720:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82169ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260725:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82169ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260729:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76e00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478525.260732:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82169ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260736:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82169ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260744:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:2.0:1789478525.260756:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478525.260760:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82169ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.260765:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82169ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478525.260831:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3fcabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+58:12319:x1876403945552256:12345-192.168.206.11@tcp:34:lfs.0 Request processed in 519us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478525.260838:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 179 00000100:00100000:1.0:1789478525.263457:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478525.263580:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945552512 00000100:00100000:0.0:1789478525.263962:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945552512 00000100:00100000:0.0:1789478525.264021:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 46 00000100:00100000:0.0:1789478525.264032:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+58:12319:x1876403945552512:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:0.0:1789478525.264260:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+59:12319:x1876403945552512:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 229us (809us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1789478525.264277:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 46 00000100:00100000:1.0:1789478525.303445:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478525.304423:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945552768 00000100:00100000:3.0:1789478525.304434:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945552768 00000100:00100000:2.0:1789478525.305076:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 180 00000100:00100000:2.0:1789478525.305088:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+59:12322:x1876403945552768:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:2.0:1789478525.305110:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478525.305129:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82169d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7532 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.305438:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82169dc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.305452:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82169dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.305462:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82169dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.305473:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e82169e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.305480:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e82169e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.305485:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e82169e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.305578:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82169ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.305588:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82169ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.305622:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82169ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478525.305650:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789478525.305719:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82169dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.305727:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82169dc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.305734:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82169dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.305739:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77e00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478525.305743:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82169dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.305750:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82169dc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.305761:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:2.0:1789478525.305764:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478525.305768:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82169dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.307873:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e82169dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.307893:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e82169e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.307899:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e82169e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.307924:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e82169e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.307930:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478525.307935:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e82169e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.307942:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e82169e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.307955:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ebb02275800) 00010000:00010000:2.0:1789478525.307958:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478525.307961:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e82169e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.307966:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e82169e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.309433:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e82169d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7532 expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.309458:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82169ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7532 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.309467:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:2.0:1789478525.309469:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789478525.309472:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76000, rc 0) 00000100:00100000:2.0:1789478525.309625:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+61:12322:x1876403945552768:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 4538us (6186us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789478525.309646:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 180 00000100:00100000:1.0:1789478525.315653:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478525.315791:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945552896 00000100:00100000:3.0:1789478525.315800:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945552896 00000100:00100000:3.0:1789478525.315857:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 181 00000100:00100000:3.0:1789478525.315868:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+61:12322:x1876403945552896:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:3.0:1789478525.315931:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82169f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.315974:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82169f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.315986:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82169f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.316019:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82169f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.316027:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82169f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.316034:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82169f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.316040:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478525.316045:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82169f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.316052:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82169f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.316064:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:3.0:1789478525.316068:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789478525.316072:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82169f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.316078:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e82169f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478525.316146:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+61:12322:x1876403945552896:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 279us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478525.316160:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 181 00000100:00100000:3.0:1789478525.317366:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478525.317856:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945553024 00000100:00100000:2.0:1789478525.317864:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945553024 00000100:00100000:2.0:1789478525.317919:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00100000:2.0:1789478525.317929:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3fca9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+61:2395:x1876403945553024:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789478525.317942:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478525.317962:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e82169ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7532 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.317979:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:2.0:1789478525.317983:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478525.318029:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3fca9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+60:2395:x1876403945553024:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 101us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478525.318036:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00100000:3.0:1789478525.321062:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478525.321128:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945553280 00000100:00100000:2.0:1789478525.321137:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945553280 00000100:00100000:2.0:1789478525.321197:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 47 00000100:00100000:2.0:1789478525.321212:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+60:12322:x1876403945553280:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:2.0:1789478525.321417:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+61:12322:x1876403945553280:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 210us (362us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1789478525.321425:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 47 00000100:00100000:1.0:1789478525.466802:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478525.468205:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945553536 00000100:00100000:3.0:1789478525.468217:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945553536 00000100:00100000:3.0:1789478525.468290:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 182 00000100:00100000:3.0:1789478525.468300:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+61:12340:x1876403945553536:12345-192.168.206.11@tcp:101:cat.0 00010000:00010000:3.0:1789478525.468323:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478525.468342:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e82169ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7539 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.468437:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216a06 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.468452:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216a06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.468462:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216a06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478525.468485:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789478525.468577:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e82169ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7539 expref: 64 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.468701:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216a06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7539 expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.468710:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:3.0:1789478525.468725:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789478525.468729:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fd800, rc 0) 00000100:00100000:3.0:1789478525.469205:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+63:12340:x1876403945553536:12345-192.168.206.11@tcp:101:cat.0 Request processed in 905us (2410us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1789478525.469214:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 182 00010000:00010000:0.0:1789478525.479198:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478525.488201:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478525.488302:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945553664 00000100:00100000:2.0:1789478525.488312:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945553664 00000100:00100000:2.0:1789478525.488368:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 183 00000100:00100000:2.0:1789478525.488378:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+63:12341:x1876403945553664:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:2.0:1789478525.488415:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478525.488433:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216a14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7540 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.488492:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e8216a1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.488505:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e8216a1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.488516:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e8216a1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478525.488558:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789478525.488562:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789478525.488633:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e8216a1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.488658:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216a14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7540 expref: 65 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.488676:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e8216a1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7540 expref: 64 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478525.488685:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:2.0:1789478525.488688:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789478525.488692:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f77600, rc 0) 00000100:00100000:2.0:1789478525.488765:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+64:12341:x1876403945553664:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 388us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478525.488772:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 183 00000100:00100000:2.0:1789478525.492258:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478525.492524:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945554048 00000100:00100000:0.0:1789478525.492534:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945554048 00000100:00100000:0.0:1789478525.492591:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 48 00000100:00100000:0.0:1789478525.492643:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0373f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+64:12341:x1876403945554048:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:0.0:1789478525.492909:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0373f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+65:12341:x1876403945554048:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 268us (657us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1789478525.492918:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 48 00000100:00100000:1.0:1789478525.499169:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478525.499339:0:10392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945554176 00000100:00100000:0.0:1789478525.499348:0:10392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945554176 00000100:00100000:0.0:1789478525.499406:0:10392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00100000:0.0:1789478525.499416:0:10392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+65:12341:x1876403945554176:12345-192.168.206.11@tcp:103:lfs.0 00010000:00010000:0.0:1789478525.499429:0:10392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789478525.499451:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e82169ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7524 expref: 65 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478525.499471:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216a06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7539 expref: 64 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478525.499482:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e82168a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74de expref: 63 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478525.499503:0:10392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:0.0:1789478525.499508:0:10392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478525.499563:0:10392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+62:12341:x1876403945554176:12345-192.168.206.11@tcp:103:lfs.0 Request processed in 148us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478525.499571:0:10392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00100000:2.0:1789478525.503053:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478525.503509:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945554304 00000100:00100000:3.0:1789478525.503519:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945554304 00000100:00100000:3.0:1789478525.503715:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 184 00000100:00100000:3.0:1789478525.503726:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0373c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+62:12341:x1876403945554304:12345-192.168.206.11@tcp:58:lfs.0 00010000:00010000:3.0:1789478525.503825:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216a22 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.503842:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216a22 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.503853:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216a22 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789478525.503968:0:10096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1789478525.504311:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0373c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+62:12341:x1876403945554304:12345-192.168.206.11@tcp:58:lfs.0 Request processed in 586us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478525.504319:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 184 00000100:00100000:2.0:1789478525.525878:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478525.526010:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945554432 00000100:00100000:3.0:1789478525.526019:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945554432 00000100:00100000:3.0:1789478525.526123:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 185 00000100:00100000:3.0:1789478525.526133:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0373ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+62:12343:x1876403945554432:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1789478525.526151:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478525.526170:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216a29 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7547 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526249:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216a30 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526262:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216a30 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526286:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216a30 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526298:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216a37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526305:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216a37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526311:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216a37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526372:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216a3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526382:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216a3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526389:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216a3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478525.526427:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789478525.526430:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789478525.526446:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216a3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526466:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216a3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526473:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216a30 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526478:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216a30 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526483:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216a30 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526488:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478525.526491:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216a30 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526497:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216a30 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526507:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:3.0:1789478525.526510:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478525.526514:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216a30 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526519:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216a30 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526530:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216a37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526536:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216a37 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526545:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216a37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526549:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478525.526552:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216a37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526557:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216a37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526564:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ebb02275800) 00010000:00010000:3.0:1789478525.526566:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478525.526569:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216a37 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526574:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216a37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526655:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216a29 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7547 expref: 64 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526668:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216a3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7547 expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478525.526675:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:3.0:1789478525.526677:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789478525.526680:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc42177000, rc 0) 00000100:00100000:3.0:1789478525.526733:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0373ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+63:12343:x1876403945554432:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 601us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478525.526748:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 185 00000004:00080000:0.0:1789478525.673994:0:8828:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 354789397055ns, next at 355789394634ns, rc = 0 00000100:00100000:0.0:1789478525.674025:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789478525.674043:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964479360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789478525.674104:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478525.674147:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964479360 00000100:00100000:0.0:1789478525.674154:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964479360 00000100:00100000:0.0:1789478525.674202:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789478525.674211:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876403964479360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789478525.674236:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789478525.674288:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876403964479360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478525.674296:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1789478525.674315:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789478525.674346:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964479360:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789478526.054093:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789478526.054102:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789478526.054197:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789478526.054203:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789478526.054335:0:13792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876403964479488:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789478526.054412:0:13792:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb034bff00 going to sleep for 11 seconds 00000100:00100000:1.0:1789478526.063335:0:13792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876403964479488:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789478526.066399:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478526.066574:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945554560 00000100:00100000:0.0:1789478526.066582:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945554560 00000100:00100000:0.0:1789478526.066696:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 186 00000100:00100000:0.0:1789478526.066708:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+63:12354:x1876403945554560:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789478526.066735:0:6519:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789478526.066830:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+63:12354:x1876403945554560:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 125us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478526.066837:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 186 00000100:00080000:0.0:1789478526.066856:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789478526.073247:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478526.073332:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945554688 00000100:00100000:2.0:1789478526.073342:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945554688 00000100:00100000:2.0:1789478526.073420:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 187 00000100:00100000:2.0:1789478526.073431:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+63:12354:x1876403945554688:12345-192.168.206.11@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789478526.073494:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216a45 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073510:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216a45 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073523:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216a45 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073537:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216a4c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073545:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216a4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073552:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216a4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073581:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216a53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073590:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216a53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073625:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216a53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478526.073663:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789478526.073667:0:10096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789478526.073678:0:10096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216a53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073689:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216a45 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073696:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216a45 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073704:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216a45 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073710:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478526.073714:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216a45 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073732:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216a45 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073749:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ebc40e36e00) 00010000:00010000:2.0:1789478526.073757:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478526.073761:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216a45 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073768:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216a45 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073783:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216a4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073789:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216a4c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073796:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216a4c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073801:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76c00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478526.073804:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216a4c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073811:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216a4c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073817:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8ebc1046f300) 00010000:00010000:2.0:1789478526.073820:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478526.073822:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216a4c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073828:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216a4c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073840:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216a53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073850:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216a53 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073857:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216a53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073862:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478526.073865:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216a53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073871:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216a53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073877:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:2.0:1789478526.073879:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478526.073882:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216a53 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.073887:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216a53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478526.073953:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+63:12354:x1876403945554688:12345-192.168.206.11@tcp:34:lhsmtool_posix.0 Request processed in 520us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478526.073960:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 187 00000100:00100000:1.0:1789478526.076699:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478526.076872:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945554944 00000100:00100000:3.0:1789478526.076882:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945554944 00000100:00100000:3.0:1789478526.076929:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 188 00000100:00100000:3.0:1789478526.076939:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+63:12354:x1876403945554944:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789478526.076957:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478526.076974:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216a5a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b754e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.077058:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216a61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.077072:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216a61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.077083:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216a61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478526.077092:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789478526.077248:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216a61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.077256:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216a61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.077275:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216a61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.077281:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc42176c00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478526.077286:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216a61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.077304:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216a61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.077317:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:3.0:1789478526.077320:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789478526.077324:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216a61 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.077330:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216a61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.077366:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216a5a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b754e expref: 65 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.077376:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ebc40e36e00) 00010000:00010000:3.0:1789478526.077378:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789478526.077382:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216a5a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b754e expref: 65 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.077391:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc42176000, rc 0) 00000100:00100000:1.0:1789478526.077741:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478526.077775:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478526.077801:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478526.077822:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478526.077839:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478526.077857:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478526.077876:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945555200 00000100:00100000:1.0:1789478526.077881:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945555200 00000100:00100000:1.0:1789478526.077911:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945555712 00000100:00100000:1.0:1789478526.077913:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945555712 00000100:00100000:1.0:1789478526.077925:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945555584 00000100:00100000:1.0:1789478526.077927:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945555584 00000100:00100000:1.0:1789478526.077941:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 271 00000100:00100000:1.0:1789478526.077948:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945555200:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478526.077994:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945555200:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 46us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478526.078000:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 271 00000100:00100000:1.0:1789478526.078014:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 272 00000100:00100000:1.0:1789478526.078020:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2397:x1876403945555712:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478526.078037:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2397:x1876403945555712:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 17us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478526.078043:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 272 00000100:00100000:1.0:1789478526.078052:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 273 00000100:00100000:1.0:1789478526.078057:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03feed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2397:x1876403945555584:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478526.078073:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03feed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2397:x1876403945555584:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 16us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478526.078079:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 273 00000100:00100000:1.0:1789478526.078094:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945555456 00000100:00100000:3.0:1789478526.078633:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+64:12354:x1876403945554944:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 1693us (1939us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1789478526.078641:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 188 00000100:00100000:1.0:1789478526.078878:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945555456 00000100:00100000:1.0:1789478526.078918:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945555328 00000100:00100000:1.0:1789478526.078921:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945555328 00000100:00100000:1.0:1789478526.078942:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 132 00000100:00100000:1.0:1789478526.078950:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2397:x1876403945555456:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478526.078977:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2397:x1876403945555456:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 29us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478526.078983:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 132 00000100:00100000:1.0:1789478526.078994:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 133 00000100:00100000:1.0:1789478526.078999:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2397:x1876403945555328:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478526.079158:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2397:x1876403945555328:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 157us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478526.079165:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 133 00000100:00100000:1.0:1789478526.079186:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945555072 00000100:00100000:1.0:1789478526.079189:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945555072 00000100:00100000:1.0:1789478526.079246:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 377 00000100:00100000:1.0:1789478526.079254:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2397:x1876403945555072:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478526.079288:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2397:x1876403945555072:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 35us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478526.079294:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 377 00000100:00080000:1.0:1789478526.079361:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789478526.079366:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789478526.079368:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789478526.079371:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789478526.081380:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478526.081722:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945555840 00000100:00100000:3.0:1789478526.081731:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945555840 00000100:00100000:3.0:1789478526.081812:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 189 00000100:00100000:3.0:1789478526.081822:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+64:12354:x1876403945555840:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789478526.081861:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789478526.081976:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+64:12354:x1876403945555840:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 156us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478526.081983:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 189 00000100:00100000:1.0:1789478526.086894:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478526.086925:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945556096 00000100:00100000:1.0:1789478526.086939:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945556096 00000100:00100000:1.0:1789478526.086984:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 190 00000100:00100000:1.0:1789478526.086993:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+64:12354:x1876403945556096:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789478526.087010:0:13638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478526.087013:0:13638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789478526.087036:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e8216a1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7540 expref: 64 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.087051:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:1.0:1789478526.087056:0:13638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789478526.087068:0:13638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216a6f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7555 expref: -99 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789478526.088738:0:13638:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1789478526.088889:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8216a76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.088904:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8216a76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.088915:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8216a76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.088968:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216a6f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7555 expref: 66 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.088984:0:13638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8216a76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7555 expref: 65 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.089003:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ebb024f4400) 00010000:00010000:1.0:1789478526.089006:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789478526.089010:0:13638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4aa00, rc 0) 00000100:00100000:1.0:1789478526.089071:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+65:12354:x1876403945556096:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 2079us (2184us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1789478526.089080:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 190 00000040:00080000:2.0:1789478526.090030:0:14700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789478526.090037:0:14700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789478526.090070:0:14700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789478526.090077:0:14700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789478526.092700:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478526.092833:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945556352 00000100:00100000:1.0:1789478526.092842:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945556352 00000100:00100000:1.0:1789478526.092955:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 191 00000100:00100000:1.0:1789478526.092966:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+65:12354:x1876403945556352:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789478526.093014:0:10096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478526.093038:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8216a76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7555 expref: 65 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.093054:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ebb024f4400) 00010000:00010000:1.0:1789478526.093063:0:10096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789478526.093082:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e8216a84 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.093094:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e8216a84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.093104:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e8216a84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.093118:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216a8b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x207ab638 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.093140:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216a8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x207ab638 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.093147:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216a8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x207ab638 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.093188:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e8216a84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.093195:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e8216a84 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.093202:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e8216a84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.093209:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4a000 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478526.093214:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e8216a84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.093222:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e8216a84 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.093230:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:1.0:1789478526.093233:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478526.093237:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e8216a84 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.093244:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e8216a84 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.093253:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216a8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x207ab638 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.093279:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216a8b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x207ab638 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.093286:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216a8b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x207ab638 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.093291:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4b600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478526.093294:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216a8b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x207ab638 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.093301:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216a8b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x207ab638 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.093308:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x207ab638 (ffff8ebb024f4800) 00010000:00010000:1.0:1789478526.093311:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478526.093313:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216a8b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x207ab638 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.093320:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216a8b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x207ab638 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478526.093396:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+64:12354:x1876403945556352:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 431us (703us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789478526.093404:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 191 00000100:00100000:1.0:1789478526.095969:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478526.096000:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945556480 00000100:00100000:1.0:1789478526.096007:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945556480 00000100:00100000:1.0:1789478526.096049:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 192 00000100:00100000:1.0:1789478526.096059:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03feca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+64:12354:x1876403945556480:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789478526.096083:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478526.096104:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a400/0x8ebaae74e8216a92 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b755c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.096135:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e8216a99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.096148:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e8216a99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.096159:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e8216a99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.096250:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a400/0x8ebaae74e8216a92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b755c expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.096282:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e8216a99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b755c expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.096292:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ebb024f4100) 00010000:00010000:1.0:1789478526.096296:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789478526.096298:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4ac00, rc 0) 00000100:00100000:1.0:1789478526.096345:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03feca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+65:12354:x1876403945556480:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 287us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478526.096354:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 192 00000100:00100000:0.0:1789478526.106748:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478526.108196:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945556736 00000100:00100000:1.0:1789478526.108208:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945556736 00000100:00100000:1.0:1789478526.108290:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 193 00000100:00100000:1.0:1789478526.108302:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+65:12354:x1876403945556736:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789478526.108382:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216aa0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.108398:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216aa0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.108410:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216aa0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789478526.108549:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1789478526.108559:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 355223964320ns, next at 356223961805ns, rc = 0 00000004:00010000:1.0:1789478526.108618:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e47acfc reply state 00000000fba53da4 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216aa0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.108632:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216aa0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.108639:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ebb024f4100) 00010000:00010000:1.0:1789478526.108643:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789478526.108646:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789478526.108741:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+67:12354:x1876403945556736:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 441us (1998us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789478526.108748:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 193 00000100:00100000:1.0:1789478526.116487:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478526.116555:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945556864 00000100:00100000:3.0:1789478526.116563:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945556864 00000100:00100000:3.0:1789478526.116640:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 194 00000100:00100000:3.0:1789478526.116650:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+67:12354:x1876403945556864:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789478526.116671:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478526.116690:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216aa7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7563 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.116741:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216aa7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7563 expref: 68 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.116755:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216aa7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7563 expref: 68 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.116783:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ebb024f4100) 00010000:00010000:3.0:1789478526.116787:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789478526.116790:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc42176000, rc 0) 00000100:00100000:3.0:1789478526.116838:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+68:12354:x1876403945556864:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 190us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478526.116845:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 194 00000100:00100000:3.0:1789478526.128566:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478526.128640:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945556992 00000100:00100000:2.0:1789478526.128649:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945556992 00000100:00100000:2.0:1789478526.128727:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00100000:1.0:1789478526.128760:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03784e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+6:2395:x1876403945556992:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789478526.128983:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03784e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2395:x1876403945556992:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 Request processed in 246us (425us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789478526.128991:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00100000:0.0:1789478526.144453:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478526.145127:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945557248 00000100:00100000:2.0:1789478526.145137:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945557248 00000100:00100000:2.0:1789478526.146283:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 49 00000100:00100000:2.0:1789478526.146298:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+68:12354:x1876403945557248:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789478526.146512:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+69:12354:x1876403945557248:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 218us (2065us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1789478526.146520:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 49 00000100:00100000:0.0:1789478526.149321:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478526.149738:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945557504 00000100:00100000:1.0:1789478526.149748:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945557504 00000100:00100000:1.0:1789478526.151218:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 195 00000100:00100000:1.0:1789478526.151233:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+69:12354:x1876403945557504:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789478526.151358:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+69:12354:x1876403945557504:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 129us (2042us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478526.151366:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 195 00000100:00100000:1.0:1789478526.155242:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478526.155776:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945557632 00000100:00100000:2.0:1789478526.155786:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945557632 00000100:00100000:2.0:1789478526.155840:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 196 00000100:00100000:2.0:1789478526.155851:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+69:12354:x1876403945557632:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789478526.155869:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478526.155888:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216aae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b756a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.155944:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216ab5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.155956:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.155965:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478526.156005:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789478526.156022:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.156046:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216aae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b756a expref: 71 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.156074:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b756a expref: 70 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.156083:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ebb024f4100) 00010000:00010000:2.0:1789478526.156086:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789478526.156089:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76c00, rc 0) 00000100:00100000:2.0:1789478526.156141:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+70:12354:x1876403945557632:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 293us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478526.156147:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 196 00000100:00100000:3.0:1789478526.160484:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478526.160643:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945557760 00000100:00100000:1.0:1789478526.160653:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945557760 00000100:00100000:1.0:1789478526.160719:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 59 00000100:00100000:1.0:1789478526.160730:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2397:x1876403945557760:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789478526.160748:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478526.160768:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a442e12/0x8ebaae74e8216abc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7571 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789478526.160793:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9467d, blocks: 0x0 00010000:00010000:1.0:1789478526.160812:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=355s v=(0 0) 00010000:00010000:1.0:1789478526.160816:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478526.160825:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a442e12/0x8ebaae74e8216abc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7571 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.160853:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a442e12/0x8ebaae74e8216abc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7571 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.160867:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4aa00, rc 0) 00000100:00100000:1.0:1789478526.160934:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2397:x1876403945557760:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 205us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478526.160940:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 59 00000100:00100000:1.0:1789478526.163312:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478526.163374:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945558016 00000100:00100000:3.0:1789478526.163383:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945558016 00000100:00100000:3.0:1789478526.163436:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 197 00000100:00100000:3.0:1789478526.163447:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+70:12354:x1876403945558016:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789478526.163541:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+70:12354:x1876403945558016:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 96us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478526.163549:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 197 00000100:00100000:3.0:1789478526.165962:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478526.166065:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945558144 00000100:00100000:1.0:1789478526.166074:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945558144 00000100:00100000:1.0:1789478526.166128:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 60 00000100:00100000:1.0:1789478526.166138:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:12354:x1876403945558144:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789478526.166154:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478526.166171:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3e5c5fd/0x8ebaae74e8216ac3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7578 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.166201:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a442e12/0x8ebaae74e8216abc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7571 expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.166210:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478526.166214:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478526.166220:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3e5c5fd/0x8ebaae74e8216ac3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7578 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.166255:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a442e12/0x8ebaae74e8216abc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7571 expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.166281:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a442e12/0x8ebaae74e8216abc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7571 expref: 9 pid: 8430 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478526.166296:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1876403964479616:192.168.206.11@tcp:104: 00000100:00100000:1.0:1789478526.166396:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095b1600 going to sleep for 11 seconds 00000100:00100000:1.0:1789478526.168137:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1876403964479616:192.168.206.11@tcp:104: 00010000:00010000:1.0:1789478526.168165:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e3e5c5fd/0x8ebaae74e8216ac3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7578 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.168182:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4b200, rc 0) 00000100:00100000:1.0:1789478526.168235:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:12354:x1876403945558144:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 2098us (2280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478526.168243:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 60 00000100:00100000:2.0:1789478526.171219:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478526.172580:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945558272 00000100:00100000:0.0:1789478526.172612:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945558272 00010000:00010000:0.0:1789478526.172658:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a442e12/0x8ebaae74e8216abc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7571 expref: 9 pid: 8430 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478526.172720:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 87 00000100:00100000:0.0:1789478526.172731:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:2395:x1876403945558272:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478526.172745:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478526.172765:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a442e12/0x8ebaae74e8216abc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7571 expref: 9 pid: 8430 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478526.172778:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a442e12/0x8ebaae74e8216abc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7571 expref: 9 pid: 8430 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478526.172802:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a442e12/0x8ebaae74e8216abc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7571 expref: 9 pid: 8430 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478526.172818:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478526.172822:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478526.172837:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3e5c5fd/0x8ebaae74e8216ac3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7578 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478526.172860:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3e5c5fd/0x8ebaae74e8216ac3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7578 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478526.172897:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e3e5c5fd/0x8ebaae74e8216ac3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7578 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478526.172911:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f8b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6503:1876403964479744:192.168.206.11@tcp:105: 00000100:00100000:0.0:1789478526.172992:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc359b6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789478526.174849:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f8b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6503:1876403964479744:192.168.206.11@tcp:105: 00010000:00010000:0.0:1789478526.174873:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478526.174923:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2395:x1876403945558272:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 2194us (3713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478526.174933:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 87 00000100:00100000:3.0:1789478526.180912:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478526.182690:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945558400 00000100:00100000:1.0:1789478526.182708:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945558400 00002000:00100000:1.0:1789478526.182784:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8ebb035e8a80 x1876403945558400/t0(0) o4->327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp:187/0 lens 504/0 e 0 to 0 dl 1789478537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789478526.182796:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ebb035e8a80 with x1876403945558400 ext(0->8) 00002000:00010000:1.0:1789478526.182802:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ebb035e8a80 00000100:00100000:1.0:1789478526.182847:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:1.0:1789478526.182859:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2396:x1876403945558400:12345-192.168.206.11@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789478526.184869:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+10:2396:x1876403945558400:12345-192.168.206.11@tcp:4:lhsmtool_posix.0 Request processed in 1615us (3566us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789478526.184882:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 4 00002000:00100000:1.0:1789478526.184894:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8ebb035e8a80 x1876403945558400/t4294967315(0) o4->327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp:187/0 lens 504/448 e 0 to 0 dl 1789478537 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789478526.184903:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ebb035e8a80 with x1876403945558400 ext(0->8) 00002000:00010000:1.0:1789478526.184908:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ebb035e8a80 00000100:00100000:0.0:1789478526.185179:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964479872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789478526.185236:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478526.185564:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964479872 00000100:00100000:1.0:1789478526.185573:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964479872 00000100:00100000:1.0:1789478526.185684:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789478526.185693:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964479872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789478526.185716:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00080000:3.0:1789478526.185900:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789478526.186551:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478526.186584:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945558528 00000100:00100000:3.0:1789478526.186590:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945558528 00000100:00100000:3.0:1789478526.186652:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 198 00000100:00100000:3.0:1789478526.186662:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb035eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+70:12354:x1876403945558528:12345-192.168.206.11@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789478526.192644:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964479872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6942us (7398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478526.192658:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789478526.193539:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964479872:0@lo:13:osp-pre-0-1.0 00000001:00080000:0.0:1789478526.198064:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:0.0:1789478526.198080:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:0.0:1789478526.198106:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:1.0:1789478526.198211:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e82167eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198224:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e82167eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198232:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e82167eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198249:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478526.198254:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e82167eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198272:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e82167eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198288:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ebc1046ff00) 00010000:00010000:1.0:1789478526.198301:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478526.198307:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e82167eb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198314:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e82167eb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198346:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e82167f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198353:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e82167f2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198358:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e82167f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198363:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fdc00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478526.198366:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e82167f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198371:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e82167f2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198379:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:1.0:1789478526.198382:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478526.198385:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e82167f2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198392:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e82167f2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198407:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216831 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198414:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216831 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198420:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216831 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198431:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67c00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478526.198434:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216831 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198441:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216831 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198449:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ebb02275800) 00010000:00010000:1.0:1789478526.198451:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478526.198454:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216831 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198459:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216831 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198488:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216934 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198495:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216934 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198501:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216934 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198505:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fce00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478526.198508:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216934 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198514:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216934 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198533:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:1.0:1789478526.198535:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478526.198538:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216934 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198543:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216934 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198554:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216957 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198559:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216957 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198565:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216957 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198569:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478526.198571:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216957 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198577:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216957 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198583:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:1.0:1789478526.198585:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478526.198588:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216957 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198613:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216957 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198636:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e821699d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198643:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e821699d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198649:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e821699d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198653:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67a00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478526.198656:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e821699d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198662:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e821699d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198670:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:1.0:1789478526.198673:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478526.198675:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e821699d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198681:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e821699d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198692:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216aa0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198697:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216aa0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198703:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216aa0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198713:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4b600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478526.198716:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216aa0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198722:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216aa0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198730:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ebb024f4100) 00010000:00010000:1.0:1789478526.198731:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789478526.198734:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216aa0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.198740:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216aa0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789478526.199245:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1789478526.199258:0:6496:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ebb0360ecc0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1789478526.199271:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ebb03e14f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ebb0360e840 00000020:00080000:0.0:1789478526.199283:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ebb03e14e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ebc34d76000 00000100:00100000:0.0:1789478526.199711:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb035eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+19:12354:x1876403945558528:12345-192.168.206.11@tcp:44:lhsmtool_posix.0 Request processed in 13045us (13158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478526.199721:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 198 00000100:00100000:2.0:1789478526.200773:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964480000:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789478526.200828:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478526.200886:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964480128:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789478526.200912:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478526.200944:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964480000 00000100:00100000:2.0:1789478526.200951:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964480000 00000100:00100000:2.0:1789478526.200996:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964480128 00000100:00100000:2.0:1789478526.200999:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964480128 00000100:00100000:2.0:1789478526.201021:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789478526.201029:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964480000:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789478526.201212:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789478526.201216:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789478525 00002000:00010000:2.0:1789478526.201219:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789478526.201222:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789478525 -> 1789478525 00002000:00010000:2.0:1789478526.201224:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789478526.201289:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876403964480000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 260us (460us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789478526.201296:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789478526.201316:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789478526.201324:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876403964480128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789478526.201338:0:8430:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:2.0:1789478526.201360:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa9467b, atime: 0x6aa9467b, ctime: 0x6aa9467b, blocks: 0x8 00010000:00010000:2.0:1789478526.201366:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea3f10dc/0x8ebaae74e8216aca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.201382:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=355s v=(0 0) 00010000:00010000:2.0:1789478526.201386:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478526.201392:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea3f10dc/0x8ebaae74e8216aca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.201406:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea3f10dc/0x8ebaae74e8216aca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.201416:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea3f10dc/0x8ebaae74e8216aca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.201423:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea3f10dc/0x8ebaae74e8216aca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.201442:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:3.0:1789478526.201515:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:2.0:1789478526.201549:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1876403964480128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 225us (635us total) trans 4294967308 rc 0/0 00000020:00080000:3.0:1789478526.201552:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789478526.201569:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1789478526.201662:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789478526.201688:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478526.201694:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea3f10dc/0x8ebaae74e8216aca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.201702:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76000 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478526.201706:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea3f10dc/0x8ebaae74e8216aca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.201715:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea3f10dc/0x8ebaae74e8216aca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.201731:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea3f10dc/0x8ebaae74e8216aca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.201738:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea3f10dc/0x8ebaae74e8216aca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.201757:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478526.201760:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478526.201762:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789478526.201792:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ebb03ff9c00/2, rc 0, transno 4294967308 00000100:00100000:2.0:1789478526.201799:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964480128:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789478526.201820:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ebb03ff9f80/2, rc 0, transno 4294967316 00000100:00100000:2.0:1789478526.201824:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964480000:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789478526.204411:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478526.204685:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945558656 00000100:00100000:1.0:1789478526.204695:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945558656 00000100:00100000:1.0:1789478526.204744:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 63 00000100:00100000:1.0:1789478526.204754:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+10:2395:x1876403945558656:12345-192.168.206.11@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789478526.207437:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:0.0:1789478526.207447:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:1.0:1789478526.208006:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2395:x1876403945558656:12345-192.168.206.11@tcp:16:lhsmtool_posix.0 Request processed in 3247us (3596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478526.208018:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 63 00000100:00100000:3.0:1789478526.218528:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478526.219884:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945558912 00000100:00100000:1.0:1789478526.219896:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945558912 00000100:00100000:1.0:1789478526.219954:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 199 00000100:00100000:1.0:1789478526.219966:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+19:12354:x1876403945558912:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789478526.220013:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478526.220044:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216ab5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b756a expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.220060:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ebb024f4100) 00010000:00010000:1.0:1789478526.220064:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789478526.220091:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216ad1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.220104:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216ad1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.220113:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216ad1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789478526.220236:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000679a4580 reply state 0000000008c329ca transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216ad1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.220248:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216ad1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.220254:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ebb024f4100) 00010000:00010000:1.0:1789478526.220256:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789478526.220259:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789478526.220371:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+20:12354:x1876403945558912:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 406us (1850us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1789478526.220380:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 199 00000100:00100000:3.0:1789478526.222746:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478526.224149:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945559040 00000100:00100000:0.0:1789478526.224227:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945559040 00000100:00100000:0.0:1789478526.224294:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 64 00000100:00100000:0.0:1789478526.224304:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2396:x1876403945559040:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789478526.224454:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789478526.224458:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789478525 -> 1789478524 00002000:00010000:0.0:1789478526.224461:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789478523 00002000:00010000:0.0:1789478526.224463:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789478525 -> 1789478524 00002000:00010000:0.0:1789478526.224465:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789478526.224525:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2396:x1876403945559040:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 Request processed in 223us (1783us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789478526.224534:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 64 00000100:00100000:2.0:1789478526.227553:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478526.227803:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945559296 00000100:00100000:3.0:1789478526.227812:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945559296 00000100:00100000:3.0:1789478526.227877:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 200 00000100:00100000:3.0:1789478526.227888:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+20:12354:x1876403945559296:12345-192.168.206.11@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789478526.227949:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ad8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.227975:0:13638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e8216a99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b755c expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.227985:0:13638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ad8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.228018:0:13638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e8216a99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b755c expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.228032:0:13638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e8216a99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b755c expref: 20 pid: 6517 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478526.228047:0:13638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb044b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13638:1876403964480256:192.168.206.11@tcp:104: 00000100:00100000:3.0:1789478526.228135:0:13638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03cd79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478526.233115:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478526.233312:0:13638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb044b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13638:1876403964480256:192.168.206.11@tcp:104: 00010000:00010000:0.0:1789478526.233337:0:13638:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ad8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478526.233403:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945559424 00000100:00100000:2.0:1789478526.233410:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945559424 00010000:00010000:2.0:1789478526.233440:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e8216a99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b755c expref: 21 pid: 6517 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478526.233475:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 88 00000100:00100000:2.0:1789478526.233484:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08341050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+21:2396:x1876403945559424:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789478526.233497:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478526.233503:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e8216a99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b755c expref: 21 pid: 6517 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.233514:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e8216a99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b755c expref: 21 pid: 6517 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.233534:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e8216a99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b755c expref: 21 pid: 6517 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.233547:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ebb024f4100) 00010000:00010000:2.0:1789478526.233551:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ad8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.233560:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.233567:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ad8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.233614:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478526.233676:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08341050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+20:2396:x1876403945559424:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 192us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478526.233684:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 88 00010000:00010000:3.0:1789478526.235357:0:13638:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.235371:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.235406:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.235414:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ad8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.235420:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ad8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.235443:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478526.235448:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ad8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.235455:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ad8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.235479:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ebb024f4100) 00010000:00010000:3.0:1789478526.235482:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789478526.235486:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ad8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.235492:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ad8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478526.237214:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+19:12354:x1876403945559296:12345-192.168.206.11@tcp:55:lhsmtool_posix.0 Request processed in 9320us (9660us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789478526.237225:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 200 00000100:00100000:1.0:1789478526.254088:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478526.254210:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945559552 00000100:00100000:3.0:1789478526.254221:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945559552 00000100:00100000:3.0:1789478526.254284:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 65 00000100:00100000:3.0:1789478526.254294:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2395:x1876403945559552:12345-192.168.206.11@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789478526.254337:0:8829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c00e760f/0x8ebaae74e8216adf lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.254358:0:8829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3e5c5fd/0x8ebaae74e8216ac3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7578 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.254378:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478526.254382:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789478526.254386:0:8829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c00e760f/0x8ebaae74e8216adf lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.254416:0:8829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e3e5c5fd/0x8ebaae74e8216ac3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7578 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.254429:0:8829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e3e5c5fd/0x8ebaae74e8216ac3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7578 expref: 8 pid: 8432 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478526.254443:0:8829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb044b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8829:1876403964480384:192.168.206.11@tcp:104: 00000100:00100000:3.0:1789478526.254516:0:8829:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03cd7780 going to sleep for 11 seconds 00000100:00100000:0.0:1789478526.268183:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478526.268317:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945559680 00000100:00100000:1.0:1789478526.268326:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945559680 00010000:00010000:1.0:1789478526.268365:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e3e5c5fd/0x8ebaae74e8216ac3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7578 expref: 9 pid: 8432 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478526.268422:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 89 00000100:00100000:1.0:1789478526.268432:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:2396:x1876403945559680:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789478526.268447:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478526.268466:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e3e5c5fd/0x8ebaae74e8216ac3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7578 expref: 9 pid: 8432 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.268478:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e3e5c5fd/0x8ebaae74e8216ac3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7578 expref: 9 pid: 8432 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.268502:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789478526.268507:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789478526.268513:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c00e760f/0x8ebaae74e8216adf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.268522:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c00e760f/0x8ebaae74e8216adf lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.268542:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478526.268588:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:2396:x1876403945559680:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 158us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478526.268620:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 89 00010000:00010000:3.0:1789478526.268960:0:8829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3e5c5fd/0x8ebaae74e8216ac3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7578 expref: 8 pid: 8432 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478526.268976:0:8829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb044b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8829:1876403964480384:192.168.206.11@tcp:104: 00010000:00010000:3.0:1789478526.268995:0:8829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c00e760f/0x8ebaae74e8216adf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.269005:0:8829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c00e760f/0x8ebaae74e8216adf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.269011:0:8829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c00e760f/0x8ebaae74e8216adf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.269038:0:8829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c00e760f/0x8ebaae74e8216adf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.269046:0:8829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c00e760f/0x8ebaae74e8216adf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.269054:0:8829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c00e760f/0x8ebaae74e8216adf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.269060:0:8829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67a00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478526.269064:0:8829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c00e760f/0x8ebaae74e8216adf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.269073:0:8829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c00e760f/0x8ebaae74e8216adf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.269086:0:8829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c00e760f/0x8ebaae74e8216adf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.269093:0:8829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c00e760f/0x8ebaae74e8216adf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478526.269169:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2395:x1876403945559552:12345-192.168.206.11@tcp:1:lhsmtool_posix.0 Request processed in 14876us (15087us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478526.269178:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 65 00000100:00100000:0.0:1789478526.272869:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478526.272943:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945559936 00000100:00100000:3.0:1789478526.272952:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945559936 00000100:00100000:3.0:1789478526.273002:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 201 00000100:00100000:3.0:1789478526.273011:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+19:12354:x1876403945559936:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789478526.273084:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ae6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.273099:0:10096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e821692d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7501 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.273108:0:10096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ae6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.273152:0:10096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e821692d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7501 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.273164:0:10096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e821692d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7501 expref: 19 pid: 6517 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478526.273179:0:10096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb044b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10096:1876403964480512:192.168.206.11@tcp:104: 00000100:00100000:3.0:1789478526.273254:0:10096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03cd7780 going to sleep for 11 seconds 00000100:00100000:1.0:1789478526.278812:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478526.278875:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945560064 00000100:00100000:0.0:1789478526.278883:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945560064 00010000:00010000:0.0:1789478526.278928:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e821692d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7501 expref: 20 pid: 6517 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478526.278978:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 90 00000100:00100000:0.0:1789478526.278987:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+20:2395:x1876403945560064:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478526.279000:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478526.279007:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e821692d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7501 expref: 20 pid: 6517 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478526.279020:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e821692d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7501 expref: 20 pid: 6517 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478526.279040:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:0.0:1789478526.279046:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ae6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478526.279055:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478526.279062:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ae6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478526.279079:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478526.279198:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+20:2395:x1876403945560064:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 211us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478526.279205:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 90 00010000:00010000:3.0:1789478526.281417:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e821692d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7501 expref: 19 pid: 6517 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478526.281441:0:10096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb044b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10096:1876403964480512:192.168.206.11@tcp:104: 00010000:00010000:3.0:1789478526.281461:0:10096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.281485:0:10096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.281491:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.281657:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216aed lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.281672:0:10096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216aa7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7563 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.281680:0:10096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216aed lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.281714:0:10096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216aa7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7563 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.281731:0:10096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216aa7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7563 expref: 19 pid: 6518 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478526.281745:0:10096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb044b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10096:1876403964480640:192.168.206.11@tcp:104: 00000100:00100000:3.0:1789478526.281831:0:10096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03cd70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478526.284122:0:10096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb044b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10096:1876403964480640:192.168.206.11@tcp:104: 00010000:00010000:0.0:1789478526.284149:0:10096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216aed lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478526.287762:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478526.288551:0:10392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945560192 00000100:00100000:2.0:1789478526.288563:0:10392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945560192 00010000:00010000:2.0:1789478526.288623:0:10392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216aa7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7563 expref: 20 pid: 6518 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478526.288672:0:10392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 91 00000100:00100000:2.0:1789478526.288684:0:10392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+20:2396:x1876403945560192:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789478526.288699:0:10392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478526.288707:0:10392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216aa7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7563 expref: 20 pid: 6518 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.288720:0:10392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216aa7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7563 expref: 20 pid: 6518 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.288741:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216aa7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7563 expref: 20 pid: 6518 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.288757:0:10392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ebb024f4100) 00010000:00010000:2.0:1789478526.288762:0:10392:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216aed lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.288771:0:10392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216aed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.288778:0:10392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216aed lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.288826:0:10392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789478526.288848:0:10096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216aed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478526.288859:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216aed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478526.288888:0:10392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+19:2396:x1876403945560192:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 206us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478526.288897:0:10392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 91 00000001:00080000:0.0:1789478526.288966:0:10096:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1789478526.289076:0:10096:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1789478526.289126:0:10096:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1789478526.289199:0:10096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f89f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10096:1876403964480768:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789478526.289246:0:10096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478526.289292:0:10096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc359b6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789478526.289740:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964480768 00000100:00100000:2.0:1789478526.289746:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964480768 00000100:00100000:2.0:1789478526.289791:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789478526.289800:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10096:x1876403964480768:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789478526.289884:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10096:x1876403964480768:12345-0@lo:1000:mdt00_003.0 Request processed in 86us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478526.289892:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789478526.289937:0:10096:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1789478526.289944:0:10096:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ebb03ff9f80, transno 4294967316 00000100:00100000:3.0:1789478526.289965:0:10096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f89f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10096:1876403964480768:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789478526.290073:0:10096:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1789478526.290128:0:10096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb044b7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10096:1876403964480896:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789478526.290166:0:10096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478526.290192:0:10096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03cd7780 going to sleep for 11 seconds 00000100:00100000:2.0:1789478526.290208:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964480896 00000100:00100000:2.0:1789478526.290214:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964480896 00000100:00100000:2.0:1789478526.290246:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789478526.290254:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10096:x1876403964480896:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789478526.290613:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10096:x1876403964480896:12345-0@lo:1000:mdt00_003.0 Request processed in 342us (427us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789478526.290621:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789478526.290655:0:10096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb044b7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10096:1876403964480896:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789478526.290685:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216aed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.290693:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216aed lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.290699:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216aed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.290705:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67c00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478526.290709:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216aed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.290716:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216aed lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.290730:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ebb024f4100) 00010000:00010000:3.0:1789478526.290733:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789478526.290736:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216aed lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.290742:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216aed lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.290792:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216a22 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.290799:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216a22 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.290812:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216a22 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.290817:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478526.290820:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216a22 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.290826:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216a22 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.290835:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:3.0:1789478526.290837:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789478526.290840:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216a22 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.290845:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216a22 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.290877:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216af4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.290891:0:10096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216a3e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7547 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.290899:0:10096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216af4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.290921:0:10096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216a3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7547 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.290945:0:10096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216a3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7547 expref: 22 pid: 6518 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478526.290957:0:10096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb044b4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10096:1876403964481024:192.168.206.11@tcp:104: 00000100:00100000:3.0:1789478526.291008:0:10096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03cd7780 going to sleep for 11 seconds 00000100:00100000:3.0:1789478526.296159:0:10096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb044b4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10096:1876403964481024:192.168.206.11@tcp:104: 00010000:00010000:3.0:1789478526.296189:0:10096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216af4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478526.297210:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478526.297393:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945560320 00000100:00100000:1.0:1789478526.297401:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945560320 00010000:00010000:1.0:1789478526.297437:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216a3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7547 expref: 23 pid: 6518 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478526.297485:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 92 00000100:00100000:1.0:1789478526.297494:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+23:2395:x1876403945560320:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789478526.297509:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478526.297517:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216a3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7547 expref: 23 pid: 6518 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.297530:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216a3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7547 expref: 23 pid: 6518 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.297550:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216a3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7547 expref: 23 pid: 6518 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.297564:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:1.0:1789478526.297569:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216af4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.297577:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216af4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.297584:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216af4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.297631:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478526.297679:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+22:2395:x1876403945560320:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 186us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478526.297687:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 92 00010000:00010000:1.0:1789478526.297710:0:10096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216af4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.297724:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216af4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.297735:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216af4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.297741:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216af4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.297747:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216af4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.297752:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc42176c00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478526.297756:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216af4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.297763:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216af4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.297786:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:1.0:1789478526.297789:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478526.297792:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216af4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.297798:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216af4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.297810:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.297816:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ae6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.297827:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ae6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.297832:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478526.297836:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ae6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.297842:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ae6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.297849:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb02275500) 00010000:00010000:1.0:1789478526.297852:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789478526.297854:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ae6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478526.297860:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ae6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478526.297976:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+21:12354:x1876403945559936:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 24965us (25116us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1789478526.297985:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 201 00000020:00080000:1.0:1789478526.297988:0:10096:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789478526.298069:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789478526.298074:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789478526.298568:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1789478526.298576:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789478526.305042:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478526.305625:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945560576 00000100:00100000:3.0:1789478526.305635:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945560576 00000100:00100000:3.0:1789478526.305685:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 50 00000100:00100000:3.0:1789478526.305695:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc0838c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+21:12354:x1876403945560576:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789478526.305996:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789478526.306023:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1789478526.306053:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216afb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.306069:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216afb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.306080:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216afb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.306088:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216afb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.306872:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216afb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.306879:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216afb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478526.306897:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789478526.306973:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478526.306982:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216afb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478526.306988:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc0838c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+23:12354:x1876403945560576:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 1290us (1949us total) trans 4294967470 rc 0/0 00010000:00010000:2.0:1789478526.306995:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67c00 already unused, calling callback (ffffffffc0d672a0) 00000100:00100000:3.0:1789478526.307002:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 50 00010000:00010000:2.0:1789478526.307003:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216afb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789478526.307009:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789478526.307015:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216afb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.307043:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ebb024f4100) 00010000:00010000:2.0:1789478526.307047:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789478526.307052:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216afb lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.307060:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216afb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478526.307072:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478526.307074:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478526.307076:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789478526.315313:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789478526.500788:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478527.525008:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478527.716780:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964481152:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789478527.716857:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478527.716959:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964481280:0@lo:400:kworker.0 00000100:00100000:2.0:1789478527.717013:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478527.717064:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964481792:0@lo:400:kworker.0 00000100:00100000:2.0:1789478527.717095:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478527.717124:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964482304:0@lo:400:kworker.0 00000100:00100000:2.0:1789478527.717146:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478527.717169:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964481792 00000100:00100000:0.0:1789478527.717176:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964481792 00000100:00100000:2.0:1789478527.717183:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789478527.717192:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964481408:0@lo:400:kworker.0 00000100:00100000:0.0:1789478527.717220:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964482304 00000100:00100000:0.0:1789478527.717224:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964482304 00000100:00100000:2.0:1789478527.717225:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478527.717295:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964481408 00000100:00100000:0.0:1789478527.717300:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964481408 00000100:00100000:0.0:1789478527.717336:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789478527.717345:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1789478527.717346:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964481792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478527.717368:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964482304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478527.717390:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964481792:12345-0@lo:400:kworker.0 Request processed in 47us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478527.717395:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789478527.717421:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964482304:12345-0@lo:400:kworker.0 Request processed in 56us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478527.717421:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789478527.717429:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964481408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478527.717434:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1789478527.717454:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964481408:12345-0@lo:400:kworker.0 Request processed in 26us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478527.717465:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789478527.717517:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964481408:0@lo:400:kworker.0 00000100:00100000:2.0:1789478527.717524:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964481920:0@lo:400:kworker.0 00000100:00100000:2.0:1789478527.717545:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478527.717567:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876403964482432:0@lo:400:kworker.0 00000100:00100000:2.0:1789478527.717615:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478527.717636:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964481792:0@lo:400:kworker.0 00000100:00100000:2.0:1789478527.717645:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964482304:0@lo:400:kworker.0 00000100:00100000:2.0:1789478527.717668:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964482816:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789478527.717689:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478527.717721:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964481152 00000100:00100000:2.0:1789478527.717725:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964481152 00000100:00100000:2.0:1789478527.717749:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964482816 00000100:00100000:2.0:1789478527.717752:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964482816 00000100:00100000:2.0:1789478527.717766:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789478527.717771:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964481152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789478527.717795:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789478527.717829:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964481152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478527.717836:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789478527.717839:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964481920 00000100:00100000:0.0:1789478527.717844:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964481920 00000100:00100000:2.0:1789478527.717852:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789478527.717860:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964482816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789478527.717875:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789478527.717922:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964482816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478527.717927:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789478527.717947:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964481536:0@lo:400:kworker.0 00000100:00100000:2.0:1789478527.717968:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478527.717987:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964482048:0@lo:400:kworker.0 00000100:00100000:0.0:1789478527.717994:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964482432 00000100:00100000:0.0:1789478527.717999:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964482432 00000100:00100000:2.0:1789478527.718014:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478527.718026:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1789478527.718035:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964481920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478527.718048:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964482560:0@lo:400:kworker.0 00000100:00100000:0.0:1789478527.718077:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964481920:12345-0@lo:400:kworker.0 Request processed in 44us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478527.718083:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478527.718091:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789478527.718112:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789478527.718117:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789478527.718122:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964481664:0@lo:400:kworker.0 00000100:00100000:0.0:1789478527.718126:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876403964482432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478527.718158:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478527.718162:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876403964482432:12345-0@lo:400:kworker.0 Request processed in 38us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478527.718168:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789478527.718177:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964481664 00000100:00100000:2.0:1789478527.718179:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964482176:0@lo:400:kworker.0 00000100:00100000:0.0:1789478527.718180:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964481664 00000100:00100000:0.0:1789478527.718193:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789478527.718200:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964481664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478527.718210:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478527.718234:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964482688:0@lo:400:kworker.0 00000100:00100000:0.0:1789478527.718240:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964481664:12345-0@lo:400:kworker.0 Request processed in 39us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478527.718249:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789478527.718271:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478527.718294:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964482048 00000100:00100000:0.0:1789478527.718298:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964482048 00000100:00100000:1.0:1789478527.718324:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964482560 00000100:00100000:1.0:1789478527.718330:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964482560 00000100:00100000:0.0:1789478527.718330:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964482176 00000100:00100000:0.0:1789478527.718336:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964482176 00000100:00100000:1.0:1789478527.718357:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964482688 00000100:00100000:1.0:1789478527.718362:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964482688 00000100:00100000:0.0:1789478527.718364:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789478527.718381:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964482048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478527.718387:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789478527.718397:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964482560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478527.718433:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964482560:12345-0@lo:400:kworker.0 Request processed in 39us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478527.718439:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789478527.718452:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789478527.718460:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1876403964482176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478527.718473:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964482048:12345-0@lo:400:kworker.0 Request processed in 93us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478527.718481:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789478527.718496:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1876403964482176:12345-0@lo:400:kworker.0 Request processed in 36us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478527.718502:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789478527.718509:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789478527.718514:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1876403964482688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478527.718562:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1876403964482688:12345-0@lo:400:kworker.0 Request processed in 39us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478527.718569:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789478527.718639:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964481152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789478527.718824:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964482688:0@lo:400:kworker.0 00000100:00100000:2.0:1789478527.718834:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964482048:0@lo:400:kworker.0 00000100:00100000:2.0:1789478527.718843:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964482560:0@lo:400:kworker.0 00000100:00100000:2.0:1789478527.718862:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964481664:0@lo:400:kworker.0 00000100:00100000:2.0:1789478527.718869:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964482176:0@lo:400:kworker.0 00000100:00100000:2.0:1789478527.718887:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964481280 00000100:00100000:2.0:1789478527.718889:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964481280 00000100:00100000:2.0:1789478527.718915:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1789478527.718925:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3645:x1876403964481280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478527.718956:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3645:x1876403964481280:12345-0@lo:400:kworker.0 Request processed in 32us (1945us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478527.718962:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00080000:2.0:1789478527.718986:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789478527.718988:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789478527.718990:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789478527.718997:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789478527.719008:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964481536 00000100:00100000:2.0:1789478527.719010:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964481536 00000100:00100000:2.0:1789478527.719022:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789478527.719026:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964481536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478527.719056:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964481536:12345-0@lo:400:kworker.0 Request processed in 29us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478527.719059:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789478527.719088:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964481536:0@lo:400:kworker.0 00000100:00100000:2.0:1789478527.719096:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964482816:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1789478527.719109:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03e99c00 x1876403964481920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478527.719116:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964481920:0@lo:400:kworker.0 00010000:00080000:2.0:1789478527.719122:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03fff100 x1876403964482432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478527.719127:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876403964482432:0@lo:400:kworker.0 00000100:00100000:2.0:1789478527.719132:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964481280:0@lo:400:kworker.0 00000040:00080000:3.0:1789478527.939199:0:14751:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789478527.939208:0:14751:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789478527.939229:0:14751:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789478527.939235:0:14751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789478528.069695:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478528.071238:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945560832 00000100:00100000:0.0:1789478528.071251:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945560832 00000100:00080000:2.0:1789478528.071978:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789478528.072423:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 202 00000100:00100000:0.0:1789478528.072440:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+23:12374:x1876403945560832:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1789478528.072463:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478528.072480:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b757f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.072576:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfc00/0x8ebaae74e8216b09 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.072590:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfc00/0x8ebaae74e8216b09 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.072627:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfc00/0x8ebaae74e8216b09 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789478528.072650:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789478528.072741:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b757f expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.073465:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfc00/0x8ebaae74e8216b09 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b757f expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.073481:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:0.0:1789478528.073484:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789478528.073487:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029dfc00, rc 0) 00000100:00100000:0.0:1789478528.073610:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+25:12374:x1876403945560832:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 1156us (3901us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1789478528.073620:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 202 00000100:00100000:3.0:1789478528.081509:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478528.082746:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945560960 00000100:00100000:0.0:1789478528.083959:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945560960 00000100:00100000:0.0:1789478528.084022:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 203 00000100:00100000:0.0:1789478528.084033:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+25:12374:x1876403945560960:12345-192.168.206.11@tcp:34:lfs.0 00010000:00010000:0.0:1789478528.084100:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b17 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084116:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b17 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084127:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b17 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084142:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e8216b1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084157:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e8216b1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084163:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e8216b1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084239:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de600/0x8ebaae74e8216b25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084247:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de600/0x8ebaae74e8216b25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084262:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de600/0x8ebaae74e8216b25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789478528.084305:0:13638:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de600/0x8ebaae74e8216b25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084318:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b17 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084325:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b17 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084331:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b17 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084339:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029df000 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478528.084342:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b17 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084349:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b17 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084367:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:0.0:1789478528.084369:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478528.084374:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b17 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084380:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b17 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084390:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e8216b1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084396:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e8216b1e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084548:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e8216b1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084553:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029de800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478528.084555:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e8216b1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084561:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e8216b1e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084569:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ebc40e75300) 00010000:00010000:0.0:1789478528.084571:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478528.084574:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e8216b1e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084580:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e8216b1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084627:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de600/0x8ebaae74e8216b25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084634:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de600/0x8ebaae74e8216b25 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084640:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de600/0x8ebaae74e8216b25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084645:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029de600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478528.084648:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de600/0x8ebaae74e8216b25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084654:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de600/0x8ebaae74e8216b25 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084663:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebc40e75a00) 00010000:00010000:0.0:1789478528.084665:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478528.084668:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de600/0x8ebaae74e8216b25 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.084674:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de600/0x8ebaae74e8216b25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478528.084748:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+25:12374:x1876403945560960:12345-192.168.206.11@tcp:34:lfs.0 Request processed in 716us (3243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478528.085404:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 203 00000100:00100000:2.0:1789478528.117379:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478528.117849:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945561216 00000100:00100000:1.0:1789478528.117859:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945561216 00000100:00100000:1.0:1789478528.117956:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 204 00000100:00100000:1.0:1789478528.117966:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+25:12377:x1876403945561216:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1789478528.117985:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478528.118003:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ba00/0x8ebaae74e8216b2c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7586 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.118066:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4bc00/0x8ebaae74e8216b33 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.118401:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4bc00/0x8ebaae74e8216b33 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.118415:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4bc00/0x8ebaae74e8216b33 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.118432:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8216b3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.118439:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8216b3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.118445:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8216b3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.118563:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216b41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.118960:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216b41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.118969:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216b41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478528.118980:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789478528.119052:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4bc00/0x8ebaae74e8216b33 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.119060:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4bc00/0x8ebaae74e8216b33 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.119067:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4bc00/0x8ebaae74e8216b33 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.119082:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4bc00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478528.119086:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4bc00/0x8ebaae74e8216b33 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.119199:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4bc00/0x8ebaae74e8216b33 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.119212:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:1.0:1789478528.119215:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478528.119221:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4bc00/0x8ebaae74e8216b33 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.119227:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4bc00/0x8ebaae74e8216b33 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.119241:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8216b3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.119247:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8216b3a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.119266:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8216b3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.119271:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4b400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478528.119274:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8216b3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.119280:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8216b3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.119299:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ebb024f4500) 00010000:00010000:1.0:1789478528.119302:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478528.119305:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8216b3a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.119311:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8216b3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.119366:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ba00/0x8ebaae74e8216b2c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7586 expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.119378:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216b41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7586 expref: 27 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.119385:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb024f4b00) 00010000:00010000:1.0:1789478528.119387:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789478528.119390:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4a600, rc 0) 00000100:00100000:1.0:1789478528.119459:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+27:12377:x1876403945561216:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 1494us (2088us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1789478528.119466:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 204 00000100:00100000:0.0:1789478528.122410:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478528.122544:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945561344 00000100:00100000:1.0:1789478528.122553:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945561344 00000100:00100000:1.0:1789478528.122640:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 205 00000100:00100000:1.0:1789478528.122650:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+27:12377:x1876403945561344:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:1.0:1789478528.122709:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216b4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.122724:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216b4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.122746:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216b4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.122781:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216b4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.122787:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216b4f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.122793:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216b4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.122798:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4b200 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478528.122803:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216b4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.122809:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216b4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.122819:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb024f4b00) 00010000:00010000:1.0:1789478528.122822:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789478528.122826:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216b4f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.122831:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216b4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478528.122900:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+27:12377:x1876403945561344:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 251us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478528.122908:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 205 00000100:00100000:3.0:1789478528.128514:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478528.128732:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945561600 00000100:00100000:2.0:1789478528.128742:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945561600 00000100:00100000:2.0:1789478528.128806:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:2.0:1789478528.128817:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+27:12377:x1876403945561600:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:2.0:1789478528.129030:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+28:12377:x1876403945561600:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 214us (523us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1789478528.129039:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:2.0:1789478528.166729:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478528.166985:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945561856 00000100:00100000:0.0:1789478528.166995:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945561856 00000100:00100000:0.0:1789478528.167106:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 206 00000100:00100000:0.0:1789478528.167117:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+28:11900:x1876403945561856:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:0.0:1789478528.167151:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478528.167170:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e8216b56 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b758d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.167281:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b5d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.167295:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216b41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7586 expref: 29 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.167304:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b5d lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.167348:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216b41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7586 expref: 29 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.167361:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216b41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7586 expref: 29 pid: 6518 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478528.167374:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964482944:192.168.206.11@tcp:104: 00000100:00100000:0.0:1789478528.167448:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc359b6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789478528.171050:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478528.171243:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945561984 00000100:00100000:1.0:1789478528.171251:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945561984 00010000:00010000:1.0:1789478528.171302:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216b41 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7586 expref: 30 pid: 6518 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478528.171444:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 93 00000100:00100000:1.0:1789478528.171455:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+30:2395:x1876403945561984:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789478528.171470:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478528.171477:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216b41 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7586 expref: 30 pid: 6518 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.171500:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216b41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7586 expref: 30 pid: 6518 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.171521:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb024f4b00) 00010000:00010000:1.0:1789478528.171527:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b5d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.171535:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.171541:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b5d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.171559:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478528.171638:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+30:2395:x1876403945561984:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 185us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478528.171644:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 93 00010000:00010000:2.0:1789478528.171722:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8216b41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7586 expref: 29 pid: 6518 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478528.171737:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964482944:192.168.206.11@tcp:104: 00010000:00010000:2.0:1789478528.171768:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.171778:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.171783:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478528.171801:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789478528.171919:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de800/0x8ebaae74e8216b56 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b758d expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.171935:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b5d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b758d expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.171943:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb024f4b00) 00010000:00010000:2.0:1789478528.171946:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789478528.171949:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029df000, rc 0) 00000100:00100000:2.0:1789478528.171973:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+29:11900:x1876403945561856:12345-192.168.206.11@tcp:101:bash.0 Request processed in 4859us (5253us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1789478528.171980:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 206 00000100:00100000:3.0:1789478528.174874:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478528.177934:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945562112 00000100:00100000:2.0:1789478528.177949:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945562112 00000100:00100000:2.0:1789478528.178021:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 207 00000100:00100000:2.0:1789478528.178031:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+29:11900:x1876403945562112:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:2.0:1789478528.178052:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478528.178072:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216b6b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7594 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.179961:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e8216b72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.179981:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e8216b72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.179993:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e8216b72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.180945:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216b6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7594 expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.180974:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e8216b72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7594 expref: 30 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.180985:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb024f4b00) 00010000:00010000:2.0:1789478528.180987:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789478528.180991:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f77600, rc 0) 00000100:00100000:2.0:1789478528.181104:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+30:11900:x1876403945562112:12345-192.168.206.11@tcp:101:bash.0 Request processed in 3073us (6248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478528.181113:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 207 00000100:00100000:0.0:1789478528.196465:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478528.200386:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945562368 00000100:00100000:2.0:1789478528.200400:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945562368 00000100:00100000:2.0:1789478528.200474:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 208 00000100:00100000:2.0:1789478528.200484:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+30:11900:x1876403945562368:12345-192.168.206.11@tcp:36:bash.0 00010000:00010000:3.0:1789478528.204742:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216b79 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.204835:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216b79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.204848:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216b79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789478528.204969:0:13638:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1789478528.204993:0:13638:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008dc6284e reply state 00000000c6025bac transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216b79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.205005:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216b79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.205012:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb024f4b00) 00010000:00010000:3.0:1789478528.205015:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789478528.205018:0:13638:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789478528.205056:0:13638:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:3.0:1789478528.205681:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+34:11900:x1876403945562368:12345-192.168.206.11@tcp:36:bash.0 Request processed in 5193us (9218us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789478528.205690:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 208 00000020:00080000:3.0:1789478528.205695:0:13638:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789478528.222425:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478528.226957:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945562496 00000100:00100000:2.0:1789478528.226972:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945562496 00000100:00100000:2.0:1789478528.227096:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 209 00000100:00100000:2.0:1789478528.227107:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+34:11900:x1876403945562496:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:2.0:1789478528.227142:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478528.227162:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216b80 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b759b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.227218:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216b80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b759b expref: 35 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.227234:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216b80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b759b expref: 35 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.227262:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb024f4b00) 00010000:00010000:2.0:1789478528.227266:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789478528.227270:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76e00, rc 0) 00000100:00100000:2.0:1789478528.227915:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+35:11900:x1876403945562496:12345-192.168.206.11@tcp:101:bash.0 Request processed in 806us (5495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478528.227924:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 209 00000100:00100000:2.0:1789478528.232889:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789478528.232914:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964483072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789478528.232974:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478528.233078:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964483072 00000100:00100000:0.0:1789478528.233086:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964483072 00000100:00100000:0.0:1789478528.233165:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789478528.233175:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876403964483072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789478528.233204:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789478528.233248:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876403964483072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478528.233268:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789478528.233314:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964483072:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789478528.233553:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789478528.236238:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789478528.236289:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb044b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964483200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789478528.236365:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478528.236546:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964483200 00000100:00100000:3.0:1789478528.236554:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964483200 00000100:00100000:3.0:1789478528.236628:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789478528.236638:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964483200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789478528.236660:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789478528.236702:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964483200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478528.236709:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789478528.236749:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb044b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964483200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789478528.239448:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478528.243288:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945562624 00000100:00100000:2.0:1789478528.243302:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945562624 00000100:00080000:0.0:1789478528.243556:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789478528.243994:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 66 00000100:00100000:3.0:1789478528.244008:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:11900:x1876403945562624:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:3.0:1789478528.244026:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478528.244059:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c00e760f/0x8ebaae74e8216b87 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b75a2 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789478528.244083:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa9467c, atime: 0x6aa9467b, ctime: 0x6aa9467c, blocks: 0x8 00010000:00010000:3.0:1789478528.244102:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1789478528.244107:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478528.244115:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c00e760f/0x8ebaae74e8216b87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75a2 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.244205:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c00e760f/0x8ebaae74e8216b87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75a2 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.244218:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b67a00, rc 0) 00000100:00100000:3.0:1789478528.244294:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:11900:x1876403945562624:12345-192.168.206.11@tcp:101:bash.0 Request processed in 290us (4854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478528.244301:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 66 00000100:00100000:1.0:1789478528.247669:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478528.247752:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945562752 00000100:00100000:2.0:1789478528.247760:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945562752 00002000:00010000:2.0:1789478528.247807:0:8436:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1789478528.247815:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ebb03fed880 with x1876403945562752 ext(0->18446744073709551615) 00002000:00010000:2.0:1789478528.247828:0:8436:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ebb03fed880. 00000100:00100000:2.0:1789478528.247863:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:2.0:1789478528.247872:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2396:x1876403945562752:12345-192.168.206.11@tcp:10:bash.0 00002000:00010000:2.0:1789478528.248102:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789478528.248105:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789478524 -> 1789478527 00002000:00010000:2.0:1789478528.248108:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1789478523 -> 1789478523 00002000:00010000:2.0:1789478528.248110:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789478524 -> 1789478527 00002000:00010000:2.0:1789478528.248113:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1789478528.248184:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:2396:x1876403945562752:12345-192.168.206.11@tcp:10:bash.0 Request processed in 311us (521us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789478528.248191:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 5 00002000:00010000:2.0:1789478528.248195:0:8436:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1789478528.248197:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ebb03fed880 with x1876403945562752 ext(0->18446744073709551615) 00002000:00010000:2.0:1789478528.248202:0:8436:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ebb03fed880. 00000100:00100000:1.0:1789478528.350146:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478528.353387:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945562880 00000100:00100000:2.0:1789478528.353401:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945562880 00000100:00100000:2.0:1789478528.353476:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 210 00000100:00100000:2.0:1789478528.353487:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+35:12391:x1876403945562880:12345-192.168.206.11@tcp:34:lfs.0 00010000:00010000:2.0:1789478528.353572:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216b8e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353589:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216b8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353646:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216b8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353662:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216b95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353669:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216b95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353675:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216b95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353747:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216b9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353767:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216b9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353774:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216b9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789478528.353814:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216b9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353825:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216b8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353842:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216b8e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353848:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216b8e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353854:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478528.353858:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216b8e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353866:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216b8e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353877:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:2.0:1789478528.353880:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478528.353884:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216b8e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353890:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216b8e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353903:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216b95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353908:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216b95 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353914:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216b95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353918:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77e00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478528.353926:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216b95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353933:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216b95 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353941:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ebc1046f300) 00010000:00010000:2.0:1789478528.353943:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478528.353946:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216b95 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353952:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216b95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353966:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216b9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353972:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216b9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353977:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216b9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353982:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478528.353985:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216b9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353990:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216b9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.353997:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb024f4b00) 00010000:00010000:2.0:1789478528.353999:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478528.354008:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216b9c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.354013:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216b9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478528.354078:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+35:12391:x1876403945562880:12345-192.168.206.11@tcp:34:lfs.0 Request processed in 592us (3939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478528.354086:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 210 00000100:00100000:1.0:1789478528.397787:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478528.398451:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945563136 00000100:00100000:3.0:1789478528.398467:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945563136 00000100:00100000:3.0:1789478528.398539:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 211 00000100:00100000:3.0:1789478528.398548:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+35:12394:x1876403945563136:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1789478528.398571:0:13638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478528.398621:0:13638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ba3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b75a9 expref: -99 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.398701:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216baa lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.398733:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216baa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.398744:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216baa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.398771:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216bb1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.398778:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.398790:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.399064:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216bb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.399074:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.399081:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478528.399091:0:13638:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789478528.399160:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216baa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.399167:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216baa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.399174:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216baa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.399187:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478528.399191:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216baa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.399200:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216baa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.399212:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:3.0:1789478528.399215:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478528.399219:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216baa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.399224:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216baa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.399236:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.399242:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216bb1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.399248:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216bb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.399263:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478528.399266:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216bb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.399272:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216bb1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.399290:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ebb02275200) 00010000:00010000:3.0:1789478528.399293:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478528.399296:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216bb1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.399301:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216bb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.399354:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67400/0x8ebaae74e8216ba3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75a9 expref: 38 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.399366:0:13638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75a9 expref: 37 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.399372:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb024f4b00) 00010000:00010000:3.0:1789478528.399374:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789478528.399377:0:13638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fce00, rc 0) 00000100:00100000:3.0:1789478528.400432:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+37:12394:x1876403945563136:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 1771us (2539us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789478528.400443:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 211 00000100:00100000:1.0:1789478528.406738:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478528.407032:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945563264 00000100:00100000:2.0:1789478528.407042:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945563264 00000100:00100000:2.0:1789478528.407100:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 212 00000100:00100000:2.0:1789478528.407110:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+37:12394:x1876403945563264:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:2.0:1789478528.407170:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216bc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.407185:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b5d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b758d expref: 37 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.407194:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216bc6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.407226:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b5d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b758d expref: 37 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.407240:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b5d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b758d expref: 37 pid: 6519 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478528.407268:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e99880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964483328:192.168.206.11@tcp:104: 00000100:00100000:2.0:1789478528.408102:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb034bf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478528.418425:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478528.418564:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945563520 00000100:00100000:1.0:1789478528.418573:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945563520 00000100:00100000:1.0:1789478528.418650:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:1.0:1789478528.418661:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+38:6629:x1876403945563520:12345-192.168.206.11@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789478528.419535:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+39:6629:x1876403945563520:12345-192.168.206.11@tcp:35:ldlm_bl.0 Request processed in 873us (1115us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1789478528.419545:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:2.0:1789478528.420029:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e99880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964483328:192.168.206.11@tcp:104: 00010000:00010000:2.0:1789478528.420055:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216bc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478528.425077:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478528.425429:0:10392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945563648 00000100:00100000:2.0:1789478528.425438:0:10392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945563648 00010000:00010000:2.0:1789478528.425475:0:10392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b5d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b758d expref: 39 pid: 6519 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478528.425583:0:10392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 94 00000100:00100000:2.0:1789478528.425626:0:10392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+39:2395:x1876403945563648:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789478528.425640:0:10392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478528.425648:0:10392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b5d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b758d expref: 39 pid: 6519 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.425660:0:10392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b5d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b758d expref: 39 pid: 6519 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.425679:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216b5d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b758d expref: 39 pid: 6519 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.425693:0:10392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb024f4b00) 00010000:00010000:2.0:1789478528.425698:0:10392:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216bc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.425707:0:10392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.425729:0:10392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216bc6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.425760:0:10392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478528.425817:0:10392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+38:2395:x1876403945563648:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 224us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478528.425824:0:10392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 94 00010000:00010000:0.0:1789478528.426042:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.426050:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.426083:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.426091:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216bc6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.426098:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.426104:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478528.426108:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.426115:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216bc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.426136:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb024f4b00) 00010000:00010000:0.0:1789478528.426139:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789478528.426143:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216bc6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.426149:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216bc6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478528.426188:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+37:12394:x1876403945563264:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 19079us (19457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478528.426195:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 212 00000100:00100000:0.0:1789478528.428337:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478528.428411:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945563904 00000100:00100000:3.0:1789478528.428420:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945563904 00000100:00100000:3.0:1789478528.428471:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 53 00000100:00100000:3.0:1789478528.428481:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+37:12394:x1876403945563904:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:3.0:1789478528.428702:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+38:12394:x1876403945563904:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 222us (371us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1789478528.428724:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 53 00000100:00100000:3.0:1789478528.527011:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478528.530143:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945564160 00000100:00100000:0.0:1789478528.530157:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945564160 00000100:00100000:0.0:1789478528.530222:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 213 00000100:00100000:0.0:1789478528.530234:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+38:12405:x1876403945564160:12345-192.168.206.11@tcp:101:cat.0 00010000:00010000:0.0:1789478528.530273:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478528.530292:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e8216bcd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b75b0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530358:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216bd4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530372:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530383:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530425:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e8216bdb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530433:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e8216bdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530441:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e8216bdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530541:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216be2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530551:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216be2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530558:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216be2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789478528.530567:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1789478528.530661:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530668:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216bd4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530674:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216bd4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530680:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029df800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478528.530684:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216bd4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530700:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216bd4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530711:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:0.0:1789478528.530714:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478528.530719:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216bd4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530725:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216bd4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530736:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e8216bdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530742:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e8216bdb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530749:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e8216bdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530753:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029de400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478528.530756:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e8216bdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530762:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e8216bdb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530769:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ebc40e75a00) 00010000:00010000:0.0:1789478528.530771:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478528.530774:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e8216bdb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530789:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e8216bdb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530828:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e8216bcd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75b0 expref: 41 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530841:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216be2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75b0 expref: 40 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.530849:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb024f4b00) 00010000:00010000:0.0:1789478528.530851:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789478528.530853:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029df400, rc 0) 00000100:00100000:0.0:1789478528.530927:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+40:12405:x1876403945564160:12345-192.168.206.11@tcp:101:cat.0 Request processed in 695us (3923us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1789478528.530942:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 213 00000100:00100000:0.0:1789478528.538810:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478528.539087:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945564416 00000100:00100000:1.0:1789478528.539097:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945564416 00000100:00100000:1.0:1789478528.539152:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 54 00000100:00100000:1.0:1789478528.539162:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+40:12405:x1876403945564416:12345-192.168.206.11@tcp:35:cat.0 00000100:00100000:1.0:1789478528.539491:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+41:12405:x1876403945564416:12345-192.168.206.11@tcp:35:cat.0 Request processed in 328us (688us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1789478528.539500:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 54 00010000:00010000:2.0:1789478528.549426:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478528.557708:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478528.557958:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945564672 00000100:00100000:3.0:1789478528.557967:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945564672 00000100:00100000:3.0:1789478528.558024:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 214 00000100:00100000:3.0:1789478528.558034:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+41:12406:x1876403945564672:12345-192.168.206.11@tcp:36:rm.0 00010000:00010000:3.0:1789478528.558084:0:13638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1789478528.558124:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216b80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b759b expref: 41 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558146:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216be2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75b0 expref: 40 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558159:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216bb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75a9 expref: 39 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558171:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e8216b72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7594 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558181:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb024f4b00) 00010000:00010000:3.0:1789478528.558185:0:13638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789478528.558204:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216bf0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558216:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216bf0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558225:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216bf0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558264:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216bf7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558272:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216bf7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558279:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216bf7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558346:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e8216bfe lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558355:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e8216bfe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558362:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e8216bfe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789478528.558563:0:13638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1789478528.558573:0:13638:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 357673978867ns, next at 358673976516ns, rc = 0 00010000:00010000:3.0:1789478528.558670:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216c05 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558680:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216c05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558688:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216c05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558695:0:13638:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216c05 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558711:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216c05 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558718:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216c05 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558745:0:13638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789478528.558763:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e8216bfe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558769:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e8216bfe lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558776:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e8216bfe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558782:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fdc00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478528.558786:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e8216bfe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558793:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e8216bfe lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558802:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb024f4b00) 00010000:00010000:3.0:1789478528.558805:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789478528.558809:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e8216bfe lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558814:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e8216bfe lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558828:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216bf0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558840:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216bf0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558845:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216bf0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558923:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478528.558928:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216bf0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558936:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216bf0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558945:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:3.0:1789478528.558948:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478528.558951:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216bf0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558957:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216bf0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789478528.558967:0:13638:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d3d19c7 reply state 00000000999605e3 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216bf7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558976:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216bf7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.558983:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ebb02275200) 00010000:00010000:3.0:1789478528.558985:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789478528.558988:0:13638:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789478528.559052:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+39:12406:x1876403945564672:12345-192.168.206.11@tcp:36:rm.0 Request processed in 1018us (1351us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1789478528.559066:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 214 00010000:00010000:2.0:1789478528.559312:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478528.559318:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216c05 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.559324:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fca00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478528.559328:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216c05 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.559334:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216c05 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.559343:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb024f4b00) 00010000:00010000:2.0:1789478528.559346:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789478528.559348:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216c05 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.559354:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216c05 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.559363:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478528.559365:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478528.559372:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478528.614956:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478528.615187:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945564928 00000100:00100000:2.0:1789478528.615196:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945564928 00000100:00100000:2.0:1789478528.615317:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 215 00000100:00100000:2.0:1789478528.615327:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+39:12412:x1876403945564928:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:2.0:1789478528.615348:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478528.615365:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216c0c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b75b7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.615447:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216c13 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.615459:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216c13 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.615470:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216c13 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.615479:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e8216c1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.615496:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e8216c1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.615503:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e8216c1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789478528.615853:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1789478528.615978:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216c21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.615987:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216c21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.616001:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216c21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.616035:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216c13 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.616042:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216c13 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.616048:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216c13 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.616052:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478528.616056:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216c13 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.616063:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216c13 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.616073:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:2.0:1789478528.616075:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478528.616079:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216c13 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.616084:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216c13 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789478528.616094:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000792b145c reply state 00000000eb8661a3 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e8216c1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.616117:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e8216c1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.616131:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ebb02275200) 00010000:00010000:2.0:1789478528.616133:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789478528.616136:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789478528.616162:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216c0c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75b7 expref: 42 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.616176:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216c21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75b7 expref: 41 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.616183:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebc1046f300) 00010000:00010000:2.0:1789478528.616185:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789478528.616187:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76c00, rc 0) 00000100:00100000:2.0:1789478528.616248:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+42:12412:x1876403945564928:12345-192.168.206.11@tcp:101:bash.0 Request processed in 922us (1300us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1789478528.616264:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 215 00000100:00100000:3.0:1789478528.619151:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478528.619302:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945565056 00000100:00100000:2.0:1789478528.619315:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945565056 00000100:00100000:2.0:1789478528.619384:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 67 00000100:00100000:2.0:1789478528.619395:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2397:x1876403945565056:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:2.0:1789478528.619411:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478528.619430:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bdc8a35/0x8ebaae74e8216c2f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b75be expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789478528.619452:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789478528.619469:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=357s v=(0 0) 00010000:00010000:2.0:1789478528.619473:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478528.619508:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bdc8a35/0x8ebaae74e8216c2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75be expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.619528:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007bdc8a35/0x8ebaae74e8216c2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75be expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.619539:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f77600, rc 0) 00000100:00100000:2.0:1789478528.619615:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2397:x1876403945565056:12345-192.168.206.11@tcp:101:bash.0 Request processed in 222us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478528.619622:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 67 00000100:00100000:3.0:1789478528.621767:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478528.621870:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945565184 00000100:00100000:1.0:1789478528.621879:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945565184 00000100:00100000:1.0:1789478528.621928:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 68 00000100:00100000:1.0:1789478528.621938:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:12412:x1876403945565184:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:1.0:1789478528.621952:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478528.621968:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f25b783a/0x8ebaae74e8216c36 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b75c5 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.622012:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007bdc8a35/0x8ebaae74e8216c2f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75be expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.622021:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478528.622024:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478528.622029:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f25b783a/0x8ebaae74e8216c36 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75c5 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.622061:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007bdc8a35/0x8ebaae74e8216c2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75be expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.622073:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007bdc8a35/0x8ebaae74e8216c2f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75be expref: 9 pid: 8432 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478528.622087:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1876403964483456:192.168.206.11@tcp:104: 00000100:00100000:1.0:1789478528.622161:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb010d6a80 going to sleep for 11 seconds 00000100:00080000:0.0:1789478528.623160:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789478528.624687:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478528.624874:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1876403964483456:192.168.206.11@tcp:104: 00010000:00010000:1.0:1789478528.624900:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f25b783a/0x8ebaae74e8216c36 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75c5 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.624920:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4ae00, rc 0) 00000100:00100000:1.0:1789478528.624968:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:12412:x1876403945565184:12345-192.168.206.11@tcp:101:bash.0 Request processed in 3031us (3221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478528.624977:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 68 00000100:00100000:0.0:1789478528.625108:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945565312 00000100:00100000:0.0:1789478528.625115:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945565312 00010000:00010000:0.0:1789478528.625142:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007bdc8a35/0x8ebaae74e8216c2f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75be expref: 9 pid: 8432 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478528.625175:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 95 00000100:00100000:0.0:1789478528.625184:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08342450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:2395:x1876403945565312:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478528.625195:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478528.625220:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007bdc8a35/0x8ebaae74e8216c2f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75be expref: 9 pid: 8432 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.625231:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007bdc8a35/0x8ebaae74e8216c2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75be expref: 9 pid: 8432 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.625261:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bdc8a35/0x8ebaae74e8216c2f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75be expref: 9 pid: 8432 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.625284:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478528.625288:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478528.625296:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f25b783a/0x8ebaae74e8216c36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75c5 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.625305:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f25b783a/0x8ebaae74e8216c36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75c5 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.625335:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f25b783a/0x8ebaae74e8216c36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75c5 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478528.625349:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6503:1876403964483584:192.168.206.11@tcp:105: 00000100:00100000:0.0:1789478528.625403:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc359b6540 going to sleep for 11 seconds 00000100:00100000:0.0:1789478528.630370:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6503:1876403964483584:192.168.206.11@tcp:105: 00010000:00010000:0.0:1789478528.630394:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478528.630483:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08342450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2395:x1876403945565312:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 5299us (5801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478528.630520:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 95 00000100:00100000:3.0:1789478528.631049:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478528.631151:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945565568 00000100:00100000:1.0:1789478528.631159:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945565568 00000100:00100000:1.0:1789478528.631240:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 55 00000100:00100000:1.0:1789478528.631259:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+42:12412:x1876403945565568:12345-192.168.206.11@tcp:35:bash.0 00000100:00100000:1.0:1789478528.631524:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+43:12412:x1876403945565568:12345-192.168.206.11@tcp:35:bash.0 Request processed in 275us (475us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1789478528.631532:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 55 00000100:00100000:3.0:1789478528.773873:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478528.774654:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945565696 00000100:00100000:1.0:1789478528.774663:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945565696 00000100:00100000:1.0:1789478528.774725:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 216 00000100:00100000:1.0:1789478528.774735:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+43:12428:x1876403945565696:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1789478528.774764:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478528.774783:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e8216c3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b75cc expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.774854:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216c44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.774867:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216c44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.774876:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216c44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478528.774914:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789478528.774917:0:10096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789478528.774935:0:10096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216c44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.774957:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e8216c3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75cc expref: 45 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.774993:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216c44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75cc expref: 44 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.775002:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:1.0:1789478528.775005:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789478528.775008:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4a800, rc 0) 00000100:00100000:1.0:1789478528.775073:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+44:12428:x1876403945565696:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 335us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478528.775080:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 216 00000100:00100000:3.0:1789478528.779228:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478528.780689:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945565952 00000100:00100000:1.0:1789478528.780700:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945565952 00000100:00100000:1.0:1789478528.780770:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 217 00000100:00100000:1.0:1789478528.780780:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+44:12428:x1876403945565952:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1789478528.780797:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478528.780814:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8216c4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b75d3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.780936:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e8216c52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.780949:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e8216c52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.780965:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e8216c52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478528.780976:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789478528.781091:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8216c4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75d3 expref: 47 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.781110:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e8216c52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75d3 expref: 46 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.781119:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebc1046f300) 00010000:00010000:1.0:1789478528.781122:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789478528.781125:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4a000, rc 0) 00000100:00100000:1.0:1789478528.781182:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+46:12428:x1876403945565952:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 403us (1961us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1789478528.781190:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 217 00000100:00100000:3.0:1789478528.786410:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478528.786456:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478528.787280:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945566336 00000100:00100000:1.0:1789478528.787291:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945566336 00000100:00100000:1.0:1789478528.787358:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:1.0:1789478528.787368:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+46:2396:x1876403945566336:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789478528.787384:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478528.787409:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e8216c52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75d3 expref: 46 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478528.787424:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945566208 00010000:00010000:1.0:1789478528.787428:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebc1046f300) 00000100:00100000:0.0:1789478528.787431:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945566208 00010000:00010000:1.0:1789478528.787435:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478528.787474:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 218 00000100:00100000:0.0:1789478528.787483:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+46:12428:x1876403945566208:12345-192.168.206.11@tcp:101:lfs.0 00000100:00100000:1.0:1789478528.787491:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+46:2396:x1876403945566336:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 122us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478528.787499:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 16 00010000:00010000:0.0:1789478528.787506:0:13638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478528.787523:0:13638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216c60 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b75da expref: -99 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.789050:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e8216c67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.789069:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e8216c67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.789081:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e8216c67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789478528.789104:0:13638:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789478528.789204:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216c60 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75da expref: 48 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.791753:0:13638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e8216c67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75da expref: 47 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.791765:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebc1046f300) 00010000:00010000:0.0:1789478528.791768:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789478528.791771:0:13638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029de400, rc 0) 00000100:00100000:0.0:1789478528.791849:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+47:12428:x1876403945566208:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 4366us (5447us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1789478528.791856:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 218 00000100:00100000:3.0:1789478528.801184:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478528.801292:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945566464 00000100:00100000:2.0:1789478528.801301:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945566464 00000100:00100000:2.0:1789478528.801361:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 69 00000100:00100000:2.0:1789478528.801371:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2396:x1876403945566464:12345-192.168.206.11@tcp:1:lfs.0 00010000:00010000:2.0:1789478528.801413:0:8829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017f094c7/0x8ebaae74e8216c75 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.801433:0:8829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f25b783a/0x8ebaae74e8216c36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75c5 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.801441:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478528.801445:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789478528.801450:0:8829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017f094c7/0x8ebaae74e8216c75 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.801485:0:8829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f25b783a/0x8ebaae74e8216c36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75c5 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.801519:0:8829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f25b783a/0x8ebaae74e8216c36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75c5 expref: 8 pid: 8430 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478528.801533:0:8829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e98000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8829:1876403964483712:192.168.206.11@tcp:104: 00000100:00100000:2.0:1789478528.801633:0:8829:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb034bf900 going to sleep for 11 seconds 00000100:00100000:3.0:1789478528.803689:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478528.803739:0:8829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e98000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8829:1876403964483712:192.168.206.11@tcp:104: 00000100:00100000:1.0:1789478528.803775:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945566592 00010000:00010000:2.0:1789478528.803780:0:8829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000017f094c7/0x8ebaae74e8216c75 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478528.803783:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945566592 00002000:00100000:1.0:1789478528.803835:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8ebb03c5bb80 x1876403945566592/t0(0) o4->327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp:189/0 lens 504/0 e 0 to 0 dl 1789478539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789478528.803843:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ebb03c5bb80 with x1876403945566592 ext(0->8) 00010000:00010000:1.0:1789478528.803851:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f25b783a/0x8ebaae74e8216c36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75c5 expref: 9 pid: 8430 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.803863:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f25b783a/0x8ebaae74e8216c36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75c5 expref: 9 pid: 8430 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789478528.803871:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ebb03c5bb80 00000100:00100000:1.0:1789478528.803902:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:1.0:1789478528.803911:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:2396:x1876403945566592:12345-192.168.206.11@tcp:4:lfs.0 00000100:00100000:1.0:1789478528.806203:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+11:2396:x1876403945566592:12345-192.168.206.11@tcp:4:lfs.0 Request processed in 2286us (2512us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789478528.806216:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 3 00002000:00100000:1.0:1789478528.806227:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8ebb03c5bb80 x1876403945566592/t4294967309(0) o4->327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp:189/0 lens 504/448 e 0 to 0 dl 1789478539 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789478528.806237:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ebb03c5bb80 with x1876403945566592 ext(0->8) 00010000:00010000:1.0:1789478528.806245:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f25b783a/0x8ebaae74e8216c36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75c5 expref: 11 pid: 8430 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.806278:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f25b783a/0x8ebaae74e8216c36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75c5 expref: 11 pid: 8430 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789478528.806286:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ebb03c5bb80 00000100:00100000:0.0:1789478528.813014:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478528.813173:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945566720 00000100:00100000:2.0:1789478528.813182:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945566720 00010000:00010000:2.0:1789478528.813218:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f25b783a/0x8ebaae74e8216c36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75c5 expref: 11 pid: 8430 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478528.813280:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 96 00000100:00100000:2.0:1789478528.813291:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+11:2398:x1876403945566720:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789478528.813305:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789478528.813320:0:6504:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789478528.813324:0:6504:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789478528 00002000:00010000:2.0:1789478528.813326:0:6504:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789478528 00002000:00010000:2.0:1789478528.813328:0:6504:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789478528 00002000:00010000:2.0:1789478528.813330:0:6504:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789478528.813336:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f25b783a/0x8ebaae74e8216c36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75c5 expref: 11 pid: 8430 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.813366:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f25b783a/0x8ebaae74e8216c36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75c5 expref: 11 pid: 8430 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.813387:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f25b783a/0x8ebaae74e8216c36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75c5 expref: 11 pid: 8430 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.814037:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789478528.814044:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789478528.814051:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017f094c7/0x8ebaae74e8216c75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.814062:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017f094c7/0x8ebaae74e8216c75 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.814096:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478528.814145:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+10:2398:x1876403945566720:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 855us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478528.814154:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 96 00010000:00010000:3.0:1789478528.814277:0:8829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000017f094c7/0x8ebaae74e8216c75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.814287:0:8829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017f094c7/0x8ebaae74e8216c75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.814309:0:8829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017f094c7/0x8ebaae74e8216c75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.814317:0:8829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017f094c7/0x8ebaae74e8216c75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.814323:0:8829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017f094c7/0x8ebaae74e8216c75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.814341:0:8829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76400 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478528.814345:0:8829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017f094c7/0x8ebaae74e8216c75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.814352:0:8829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017f094c7/0x8ebaae74e8216c75 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.814363:0:8829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017f094c7/0x8ebaae74e8216c75 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478528.814369:0:8829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017f094c7/0x8ebaae74e8216c75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478528.814414:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:2396:x1876403945566464:12345-192.168.206.11@tcp:1:lfs.0 Request processed in 13044us (13237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478528.814421:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 69 00000001:00080000:1.0:1789478528.815828:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1789478528.815841:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1789478528.817565:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478528.817710:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945566976 00000100:00100000:0.0:1789478528.817720:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945566976 00000100:00100000:0.0:1789478528.817775:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 56 00000100:00100000:0.0:1789478528.817786:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc0838f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+47:12428:x1876403945566976:12345-192.168.206.11@tcp:35:lfs.0 00000004:00010000:0.0:1789478528.817845:0:6521:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e8216c67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75da expref: 47 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789478528.818064:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1789478528.818097:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1789478528.818383:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1789478528.818419:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216c7c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.818433:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216c21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75b7 expref: 51 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.818441:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216c7c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.818473:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216c21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75b7 expref: 51 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.818486:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216c21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75b7 expref: 51 pid: 6519 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478528.818512:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6521:1876403964483840:192.168.206.11@tcp:104: 00000100:00100000:0.0:1789478528.818589:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc359b60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478528.823532:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478528.823883:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6521:1876403964483840:192.168.206.11@tcp:104: 00010000:00010000:0.0:1789478528.823908:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216c7c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478528.827023:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945567104 00000100:00100000:1.0:1789478528.827037:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945567104 00010000:00010000:1.0:1789478528.827089:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216c21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75b7 expref: 52 pid: 6519 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478528.827137:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 97 00000100:00100000:1.0:1789478528.827147:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+52:2395:x1876403945567104:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789478528.827162:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478528.827170:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216c21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75b7 expref: 52 pid: 6519 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.827182:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216c21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75b7 expref: 52 pid: 6519 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.827202:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216c21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75b7 expref: 52 pid: 6519 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.827218:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebc1046f300) 00010000:00010000:1.0:1789478528.827224:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216c7c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.827232:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216c7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.827239:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216c7c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.827327:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478528.827401:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+51:2395:x1876403945567104:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 254us (3877us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478528.827409:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 97 00010000:00010000:0.0:1789478528.834670:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216c7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.834688:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216c7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789478528.834797:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1789478528.834931:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1789478528.835026:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1876403964483968:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789478528.835096:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478528.835124:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc359b66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478528.835344:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964483968 00000100:00100000:2.0:1789478528.835352:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964483968 00000100:00100000:2.0:1789478528.835414:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789478528.835423:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6521:x1876403964483968:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789478528.835508:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6521:x1876403964483968:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 86us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478528.835514:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789478528.836104:0:6521:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:3.0:1789478528.836111:0:6521:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:3.0:1789478528.836130:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ebb03ff9c00, transno 4294967308 00000100:00100000:3.0:1789478528.836152:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1876403964483968:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789478528.836282:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1789478528.836334:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c94ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1876403964484096:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789478528.836382:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478528.837238:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03cb9480 going to sleep for 11 seconds 00000100:00100000:1.0:1789478528.841181:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964484096 00000100:00100000:1.0:1789478528.841206:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964484096 00000100:00100000:2.0:1789478528.841527:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789478528.841538:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1876403964484096:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789478528.842125:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1876403964484096:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 588us (5740us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789478528.842134:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789478528.842243:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c94ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1876403964484096:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789478528.842316:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1789478528.842355:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216c7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.842365:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216c7c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.842372:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216c7c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.842393:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029df800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478528.842397:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216c7c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.842403:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216c7c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.842418:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebc1046f300) 00010000:00010000:0.0:1789478528.842420:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789478528.842424:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216c7c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.842430:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216c7c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789478528.842525:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789478528.842579:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1789478528.842590:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 357957995692ns, next at 358957993697ns, rc = 0 00000001:00080000:0.0:1789478528.842619:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:0.0:1789478528.842643:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebc1046f300) 00010000:00010000:0.0:1789478528.842645:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789478528.842653:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e8216c67 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75da expref: 55 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478528.843116:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc0838f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+54:12428:x1876403945566976:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 25329us (25556us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1789478528.843125:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 56 00000020:00080000:0.0:1789478528.843130:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789478528.846373:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478528.847095:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945567232 00000100:00100000:1.0:1789478528.847105:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945567232 00000100:00100000:1.0:1789478528.847165:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 219 00000100:00100000:1.0:1789478528.847175:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+54:12428:x1876403945567232:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1789478528.847194:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478528.847213:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e8216c83 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b75e1 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.847273:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e8216c83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75e1 expref: 55 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.847287:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e8216c83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75e1 expref: 55 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.847304:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:1.0:1789478528.847307:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789478528.847310:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4a000, rc 0) 00000100:00100000:1.0:1789478528.847360:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+55:12428:x1876403945567232:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 187us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478528.847367:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 219 00000100:00100000:3.0:1789478528.853122:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478528.853381:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945567488 00000100:00100000:1.0:1789478528.853390:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945567488 00000100:00100000:1.0:1789478528.853453:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:1.0:1789478528.853476:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+55:12428:x1876403945567488:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:1.0:1789478528.853721:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+56:12428:x1876403945567488:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 246us (606us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789478528.853729:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:0.0:1789478528.933507:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478528.933741:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945567616 00000100:00100000:2.0:1789478528.933750:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945567616 00000100:00100000:2.0:1789478528.933919:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 220 00000100:00100000:2.0:1789478528.933930:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+56:12438:x1876403945567616:12345-192.168.206.11@tcp:34:lfs.0 00010000:00010000:2.0:1789478528.934001:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216c8a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934018:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216c8a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934031:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216c8a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934042:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216c91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934050:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216c91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934057:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216c91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934137:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216c98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934146:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216c98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934167:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216c98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789478528.934293:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216c98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934305:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216c8a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934311:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216c8a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934318:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216c8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934323:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76e00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478528.934327:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216c8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934333:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216c8a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934344:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:2.0:1789478528.934346:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478528.934351:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216c8a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934357:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216c8a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934370:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216c91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934383:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216c91 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934389:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216c91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934394:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77e00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478528.934397:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216c91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934403:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216c91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934411:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ebb02275200) 00010000:00010000:2.0:1789478528.934413:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478528.934416:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216c91 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934422:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216c91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934432:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216c98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934438:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216c98 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934443:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216c98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934447:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478528.934457:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216c98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934464:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216c98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934471:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:2.0:1789478528.934474:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478528.934477:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216c98 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478528.934483:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216c98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478528.934675:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+56:12438:x1876403945567616:12345-192.168.206.11@tcp:34:lfs.0 Request processed in 746us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478528.934683:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 220 00000100:00100000:3.0:1789478528.972111:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478528.972684:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945567872 00000100:00100000:0.0:1789478528.972694:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945567872 00000100:00100000:0.0:1789478528.972760:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 221 00000100:00100000:0.0:1789478528.972770:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+56:12441:x1876403945567872:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1789478528.972787:0:13638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478528.972806:0:13638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e8216c9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b75e8 expref: -99 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.972884:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216ca6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.972897:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.972908:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.972918:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216cad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.972925:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216cad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.972932:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216cad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.973024:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e8216cb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.973033:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e8216cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.973057:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e8216cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789478528.973067:0:13638:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789478528.973150:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.973158:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216ca6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.973164:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.973170:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029df800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478528.973174:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.973182:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216ca6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.973193:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:0.0:1789478528.973196:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478528.973200:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216ca6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.973206:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216ca6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.973218:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216cad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.973224:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216cad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.973236:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216cad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.973241:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029df400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478528.973244:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216cad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.973261:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216cad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.973270:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ebb02275200) 00010000:00010000:0.0:1789478528.973273:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478528.973276:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216cad lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.973282:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216cad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.973314:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e8216c9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75e8 expref: 59 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.973326:0:13638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e8216cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75e8 expref: 58 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478528.973333:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:0.0:1789478528.973335:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789478528.973337:0:13638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029dee00, rc 0) 00000100:00100000:0.0:1789478528.973398:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+58:12441:x1876403945567872:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 629us (1304us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1789478528.973413:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 221 00000100:00100000:3.0:1789478528.979284:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478528.979425:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945568000 00000100:00100000:1.0:1789478528.979433:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945568000 00000100:00100000:1.0:1789478528.979482:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 222 00000100:00100000:1.0:1789478528.979491:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+58:12441:x1876403945568000:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:1.0:1789478528.979546:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e8216cc2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.979561:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e8216cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.979571:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e8216cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.979625:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e8216cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.979632:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e8216cc2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.979639:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e8216cc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.979645:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4ac00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478528.979649:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e8216cc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.979670:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e8216cc2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.979680:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:1.0:1789478528.979683:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789478528.979687:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e8216cc2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478528.979693:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e8216cc2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478528.979762:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+58:12441:x1876403945568000:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 264us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478528.979769:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 222 00000100:00100000:3.0:1789478528.981771:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478528.981904:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945568256 00000100:00100000:1.0:1789478528.981912:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945568256 00000100:00100000:1.0:1789478528.981961:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00100000:1.0:1789478528.981971:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+58:12441:x1876403945568256:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:1.0:1789478528.982172:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+59:12441:x1876403945568256:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 202us (419us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1789478528.982180:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00100000:3.0:1789478529.055501:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478529.055787:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945568512 00000100:00100000:2.0:1789478529.055797:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945568512 00000100:00100000:2.0:1789478529.055859:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 223 00000100:00100000:2.0:1789478529.055870:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+59:12451:x1876403945568512:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:2.0:1789478529.055892:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478529.055895:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789478529.055921:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a800/0x8ebaae74e8216c44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75cc expref: 59 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.055939:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:2.0:1789478529.055944:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789478529.055956:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216cc9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b75ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.056060:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216cd0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.056073:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e8216cb4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75e8 expref: 59 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.056081:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216cd0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.056112:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e8216cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75e8 expref: 59 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.056124:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e8216cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75e8 expref: 59 pid: 13638 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478529.056136:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e98000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1876403964484224:192.168.206.11@tcp:104: 00000100:00100000:2.0:1789478529.056206:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb034bf900 going to sleep for 11 seconds 00000100:00100000:3.0:1789478529.060446:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478529.060638:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e98000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1876403964484224:192.168.206.11@tcp:104: 00010000:00010000:2.0:1789478529.060664:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216cd0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478529.060735:0:10392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945568640 00000100:00100000:0.0:1789478529.060742:0:10392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945568640 00010000:00010000:0.0:1789478529.060788:0:10392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e8216cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75e8 expref: 60 pid: 13638 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478529.060821:0:10392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 98 00000100:00100000:0.0:1789478529.060831:0:10392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04486d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+60:2395:x1876403945568640:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478529.060844:0:10392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478529.060851:0:10392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e8216cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75e8 expref: 60 pid: 13638 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.060874:0:10392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e8216cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75e8 expref: 60 pid: 13638 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.060893:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e8216cb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75e8 expref: 60 pid: 13638 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.060909:0:10392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:0.0:1789478529.060913:0:10392:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216cd0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.060922:0:10392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216cd0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.060929:0:10392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216cd0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.060973:0:10392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478529.061029:0:10392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04486d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+59:2395:x1876403945568640:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 199us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478529.061037:0:10392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 98 00010000:00010000:2.0:1789478529.061108:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216cd0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.061115:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216cd0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478529.061132:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789478529.061268:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216cc9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75ef expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.061283:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216cd0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75ef expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.061290:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:2.0:1789478529.061293:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789478529.061295:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f77e00, rc 0) 00000100:00100000:2.0:1789478529.061316:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+59:12451:x1876403945568512:12345-192.168.206.11@tcp:101:bash.0 Request processed in 5450us (5825us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1789478529.061322:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 223 00000100:00100000:3.0:1789478529.064467:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478529.064540:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945568768 00000100:00100000:0.0:1789478529.064548:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945568768 00000100:00100000:0.0:1789478529.064621:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 224 00000100:00100000:0.0:1789478529.064632:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+59:12451:x1876403945568768:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:0.0:1789478529.064654:0:13638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478529.064671:0:13638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e8216cde lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b75f6 expref: -99 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.064698:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216ce5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.064709:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.064720:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.064821:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029de400/0x8ebaae74e8216cde lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75f6 expref: 61 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.064837:0:13638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75f6 expref: 60 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.064846:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:0.0:1789478529.064868:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789478529.064872:0:13638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029df400, rc 0) 00000100:00100000:0.0:1789478529.064925:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+60:12451:x1876403945568768:12345-192.168.206.11@tcp:101:bash.0 Request processed in 294us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478529.064931:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 224 00000100:00100000:1.0:1789478529.068980:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478529.069081:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945569024 00000100:00100000:2.0:1789478529.069193:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945569024 00000100:00100000:2.0:1789478529.069345:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 225 00000100:00100000:2.0:1789478529.069355:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+60:12451:x1876403945569024:12345-192.168.206.11@tcp:36:bash.0 00010000:00010000:2.0:1789478529.069552:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216cec lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.069569:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216cec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.069580:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216cec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789478529.069650:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:2.0:1789478529.069671:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f8400e4 reply state 00000000655fa71b transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216cec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.069683:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216cec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.069705:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:2.0:1789478529.069707:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789478529.069711:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789478529.069869:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+63:12451:x1876403945569024:12345-192.168.206.11@tcp:36:bash.0 Request processed in 514us (895us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1789478529.069876:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 225 00000020:00080000:2.0:1789478529.069881:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789478529.072056:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478529.072285:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945569152 00000100:00100000:2.0:1789478529.072293:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945569152 00000100:00100000:2.0:1789478529.072438:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 226 00000100:00100000:2.0:1789478529.072449:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+63:12451:x1876403945569152:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:2.0:1789478529.072468:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478529.072485:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216cf3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b75fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.072558:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216cfa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.072568:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216cd0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75ef expref: 64 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.072574:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216cfa lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.072618:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216cd0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75ef expref: 64 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.072627:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216cd0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75ef expref: 64 pid: 6517 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478529.072649:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e98000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1876403964484352:192.168.206.11@tcp:104: 00000100:00100000:2.0:1789478529.072776:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb034bf900 going to sleep for 11 seconds 00000100:00100000:3.0:1789478529.075765:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478529.075987:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945569280 00000100:00100000:1.0:1789478529.075996:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945569280 00010000:00010000:1.0:1789478529.076031:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216cd0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75ef expref: 65 pid: 6517 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478529.076070:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 99 00000100:00100000:1.0:1789478529.076111:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04484a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+65:2396:x1876403945569280:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789478529.076124:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478529.076131:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216cd0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75ef expref: 65 pid: 6517 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.076144:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216cd0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75ef expref: 65 pid: 6517 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.076474:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:1.0:1789478529.076480:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216cfa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.076490:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216cfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.076497:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216cfa lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.076515:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478529.076559:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04484a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+65:2396:x1876403945569280:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 450us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478529.076565:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 99 00010000:00010000:2.0:1789478529.077973:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216cd0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75ef expref: 64 pid: 6517 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478529.077991:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e98000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1876403964484352:192.168.206.11@tcp:104: 00010000:00010000:2.0:1789478529.078013:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216cfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.078021:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216cfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.078026:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216cfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478529.078074:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789478529.078079:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789478529.078294:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216cfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.078327:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216cf3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75fd expref: 64 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.078342:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216cfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75fd expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.078351:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:2.0:1789478529.078366:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789478529.078370:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76c00, rc 0) 00000100:00100000:2.0:1789478529.078509:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+63:12451:x1876403945569152:12345-192.168.206.11@tcp:101:bash.0 Request processed in 6061us (6459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478529.078516:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 226 00000100:00100000:3.0:1789478529.081443:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478529.081995:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945569536 00000100:00100000:1.0:1789478529.082005:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945569536 00000100:00100000:1.0:1789478529.082233:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 59 00000100:00100000:1.0:1789478529.082245:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+63:12451:x1876403945569536:12345-192.168.206.11@tcp:35:bash.0 00000100:00100000:1.0:1789478529.082456:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+64:12451:x1876403945569536:12345-192.168.206.11@tcp:35:bash.0 Request processed in 213us (1020us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1789478529.082479:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 59 00000100:00100000:1.0:1789478529.147199:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478529.147270:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945569664 00000100:00100000:3.0:1789478529.147280:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945569664 00000100:00100000:3.0:1789478529.147339:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 227 00000100:00100000:3.0:1789478529.147351:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+64:12457:x1876403945569664:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1789478529.147372:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478529.147390:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216d01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7604 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.147448:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216d08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.147461:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216d08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.147471:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216d08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478529.147526:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789478529.147530:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789478529.147546:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216d08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.147570:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216d01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7604 expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.147586:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216d08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7604 expref: 65 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.147638:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:3.0:1789478529.147642:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789478529.147645:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fd400, rc 0) 00000100:00100000:3.0:1789478529.147705:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+65:12457:x1876403945569664:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 355us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478529.147712:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 227 00000100:00100000:3.0:1789478529.153705:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478529.153808:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945569792 00000100:00100000:2.0:1789478529.153817:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945569792 00000100:00100000:2.0:1789478529.153874:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 228 00000100:00100000:2.0:1789478529.153884:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+65:12457:x1876403945569792:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:2.0:1789478529.153902:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478529.153920:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216d0f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b760b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.153974:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216d16 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.153987:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216d16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.153999:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216d16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.154009:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216d1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.154016:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216d1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.154021:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216d1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.154097:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e8216d24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.154106:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e8216d24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.154112:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e8216d24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478529.154145:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789478529.154148:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789478529.154163:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e8216d24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.154173:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e8216d24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.154181:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216d16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.154187:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216d16 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.154193:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216d16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.154198:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478529.154202:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216d16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.154209:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216d16 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.154228:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:2.0:1789478529.154231:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478529.154234:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216d16 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.154240:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76400/0x8ebaae74e8216d16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.154264:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216d1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.154270:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216d1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.154276:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216d1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.154282:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478529.154285:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216d1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.154290:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216d1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.154296:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ebb02275200) 00010000:00010000:2.0:1789478529.154299:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478529.154301:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216d1d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.154306:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216d1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.154486:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216d0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b760b expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.154500:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e8216d24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b760b expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.154506:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:2.0:1789478529.154508:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789478529.154511:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f77600, rc 0) 00000100:00100000:2.0:1789478529.154569:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+66:12457:x1876403945569792:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 685us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478529.154576:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 228 00000100:00100000:2.0:1789478529.157583:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478529.157967:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945569920 00000100:00100000:1.0:1789478529.157975:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945569920 00000100:00100000:1.0:1789478529.158085:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:1.0:1789478529.158106:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+66:2395:x1876403945569920:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789478529.158121:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478529.158145:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77600/0x8ebaae74e8216d24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b760b expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.158162:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:1.0:1789478529.158166:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478529.158217:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+65:2395:x1876403945569920:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 124us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478529.158224:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:3.0:1789478529.160397:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478529.160691:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945570176 00000100:00100000:2.0:1789478529.160700:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945570176 00000100:00100000:2.0:1789478529.160758:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 229 00000100:00100000:2.0:1789478529.160766:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+65:12457:x1876403945570176:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:2.0:1789478529.160785:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478529.160805:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216d2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7612 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.160906:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216d32 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.160919:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216cfa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75fd expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.160941:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216d32 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.160968:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216cfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75fd expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.160980:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216cfa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75fd expref: 66 pid: 6517 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478529.160991:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ff9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1876403964484480:192.168.206.11@tcp:104: 00000100:00100000:2.0:1789478529.161058:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb034bf900 going to sleep for 11 seconds 00000100:00100000:3.0:1789478529.163157:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ff9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1876403964484480:192.168.206.11@tcp:104: 00010000:00010000:3.0:1789478529.163182:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216d32 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478529.165040:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478529.165231:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945570304 00000100:00100000:1.0:1789478529.165241:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945570304 00010000:00010000:1.0:1789478529.165287:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216cfa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75fd expref: 67 pid: 6517 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478529.165318:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 100 00000100:00100000:1.0:1789478529.165328:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08343050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+67:2396:x1876403945570304:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789478529.165341:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478529.165348:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216cfa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75fd expref: 67 pid: 6517 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.165377:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216cfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75fd expref: 67 pid: 6517 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.165398:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216cfa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75fd expref: 67 pid: 6517 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.165415:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:1.0:1789478529.165420:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216d32 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.165428:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216d32 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.165436:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216d32 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.166555:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478529.166635:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08343050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+66:2396:x1876403945570304:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 1305us (1599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478529.166645:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 100 00010000:00010000:2.0:1789478529.168696:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216d32 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.168711:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216d32 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478529.168735:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789478529.168999:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216d2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7612 expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.169019:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216d32 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7612 expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.169029:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:2.0:1789478529.169032:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789478529.169035:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc42176c00, rc 0) 00000100:00100000:2.0:1789478529.169292:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+66:12457:x1876403945570176:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 8525us (8900us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789478529.169301:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 229 00000100:00100000:3.0:1789478529.173547:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478529.173684:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945570560 00000100:00100000:2.0:1789478529.173692:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945570560 00000100:00100000:2.0:1789478529.173739:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:2.0:1789478529.173748:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04487b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+66:12457:x1876403945570560:12345-192.168.206.11@tcp:103:lfs.0 00010000:00010000:2.0:1789478529.173771:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478529.173792:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a000/0x8ebaae74e8216c83 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75e1 expref: 66 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.173810:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:2.0:1789478529.173814:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478529.174040:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04487b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+65:12457:x1876403945570560:12345-192.168.206.11@tcp:103:lfs.0 Request processed in 292us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478529.174048:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:3.0:1789478529.175977:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478529.176191:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945570688 00000100:00100000:1.0:1789478529.176201:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945570688 00000100:00100000:1.0:1789478529.176262:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 230 00000100:00100000:1.0:1789478529.176272:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+65:12457:x1876403945570688:12345-192.168.206.11@tcp:58:lfs.0 00010000:00010000:1.0:1789478529.176368:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8216d40 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.176384:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8216d40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.176407:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8216d40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789478529.176495:0:10096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1789478529.176685:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+65:12457:x1876403945570688:12345-192.168.206.11@tcp:58:lfs.0 Request processed in 414us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478529.176693:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 230 00000100:00100000:1.0:1789478529.183232:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478529.183324:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945570816 00000100:00100000:2.0:1789478529.183332:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945570816 00000100:00100000:2.0:1789478529.183425:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 231 00000100:00100000:2.0:1789478529.183435:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+65:12457:x1876403945570816:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:2.0:1789478529.183454:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478529.183473:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216d47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7619 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.183520:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8216d40 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.183545:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216d47 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7619 expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.183561:0:6519:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8216d40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.183572:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216d47 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7619 expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.183583:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:2.0:1789478529.183586:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789478529.183589:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216d47 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7619 expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.183685:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc42176000, rc 0) 00000100:00100000:2.0:1789478529.183743:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+66:12457:x1876403945570816:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 309us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478529.183819:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 231 00000040:00080000:1.0:1789478529.380776:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789478529.380785:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789478529.380809:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1789478529.380817:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789478529.380950:0:13792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f56a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876403964484608:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789478529.381026:0:13792:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb010d6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789478529.383861:0:13792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f56a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876403964484608:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789478529.390983:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478529.391216:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945570944 00000100:00100000:2.0:1789478529.391225:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945570944 00000100:00100000:2.0:1789478529.391299:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 232 00000100:00100000:2.0:1789478529.391309:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+66:12458:x1876403945570944:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789478529.391346:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789478529.391475:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+66:12458:x1876403945570944:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 167us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478529.391491:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 232 00000100:00100000:1.0:1789478529.400799:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478529.400938:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945571072 00000100:00100000:0.0:1789478529.400948:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945571072 00000100:00100000:0.0:1789478529.401002:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 233 00000100:00100000:0.0:1789478529.401011:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+66:12458:x1876403945571072:12345-192.168.206.11@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789478529.401082:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216d4e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401104:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216d4e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401116:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216d4e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401165:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e8216d55 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401173:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e8216d55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401181:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e8216d55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401203:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216d5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401228:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216d5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401234:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216d5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789478529.401287:0:13638:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789478529.401292:0:13638:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789478529.401303:0:13638:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216d5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401314:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216d4e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401331:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216d4e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401338:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216d4e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401344:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029df800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478529.401348:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216d4e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401355:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216d4e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401367:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ebc40e36e00) 00010000:00010000:0.0:1789478529.401370:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478529.401374:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216d4e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401398:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df800/0x8ebaae74e8216d4e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401412:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e8216d55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401418:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e8216d55 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401424:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e8216d55 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401428:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029dfa00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478529.401432:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e8216d55 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401438:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e8216d55 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401445:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8ebc40e75a00) 00010000:00010000:0.0:1789478529.401447:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478529.401450:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e8216d55 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401455:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e8216d55 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401469:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216d5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401475:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216d5c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401486:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216d5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401491:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029df000 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478529.401493:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216d5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401499:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216d5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401506:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:0.0:1789478529.401508:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478529.401511:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216d5c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.401516:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216d5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478529.401584:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+66:12458:x1876403945571072:12345-192.168.206.11@tcp:34:lhsmtool_posix.0 Request processed in 574us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478529.401639:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 233 00000100:00100000:0.0:1789478529.409859:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478529.410132:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945571328 00000100:00100000:2.0:1789478529.410141:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945571328 00000100:00100000:2.0:1789478529.410235:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 234 00000100:00100000:2.0:1789478529.410258:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+66:12458:x1876403945571328:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789478529.410276:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478529.410295:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216d63 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7620 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.410413:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216d6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.410428:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216d6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.410440:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216d6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478529.410450:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789478529.410517:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216d6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.410525:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216d6a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.410532:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216d6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.410538:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478529.410542:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216d6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.410561:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216d6a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.410574:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:2.0:1789478529.410576:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789478529.410581:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216d6a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.410588:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216d6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.410658:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216d63 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7620 expref: 68 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.410668:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ebc40e36e00) 00010000:00010000:2.0:1789478529.410670:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789478529.410674:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42177000/0x8ebaae74e8216d63 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7620 expref: 68 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.410685:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc42177000, rc 0) 00000100:00100000:2.0:1789478529.410738:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+67:12458:x1876403945571328:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 494us (886us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1789478529.410746:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 234 00000100:00100000:1.0:1789478529.415053:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478529.415277:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945571456 00000100:00100000:2.0:1789478529.415286:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945571456 00000100:00100000:2.0:1789478529.415589:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 235 00000100:00100000:2.0:1789478529.415622:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+67:12458:x1876403945571456:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789478529.415667:0:10096:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789478529.415782:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+67:12458:x1876403945571456:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 165us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478529.415789:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 235 00000100:00100000:1.0:1789478529.419488:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478529.420733:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945571712 00000100:00100000:0.0:1789478529.420744:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945571712 00000100:00100000:0.0:1789478529.420917:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 236 00000100:00100000:0.0:1789478529.420927:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+67:12458:x1876403945571712:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789478529.420946:0:13638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478529.420949:0:13638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789478529.420986:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216d08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7604 expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.421004:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:0.0:1789478529.421008:0:13638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789478529.421020:0:13638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216d78 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7627 expref: -99 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789478529.422076:0:13638:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:0.0:1789478529.422641:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e8216d7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.422656:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e8216d7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.422667:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e8216d7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.422721:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216d78 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7627 expref: 69 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.422737:0:13638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e8216d7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7627 expref: 68 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.422746:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ebc40e75a00) 00010000:00010000:0.0:1789478529.422763:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789478529.422767:0:13638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029dfa00, rc 0) 00000100:00100000:0.0:1789478529.422825:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+68:12458:x1876403945571712:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 1899us (3344us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1789478529.422861:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 236 00000100:00100000:1.0:1789478529.427145:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478529.427226:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945571968 00000100:00100000:2.0:1789478529.427236:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945571968 00000100:00100000:2.0:1789478529.427299:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 237 00000100:00100000:2.0:1789478529.427310:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+68:12458:x1876403945571968:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789478529.427371:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478529.427395:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfa00/0x8ebaae74e8216d7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7627 expref: 68 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.427412:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ebc40e75a00) 00010000:00010000:2.0:1789478529.427423:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789478529.427440:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216d8d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.427452:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216d8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.427460:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216d8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.427472:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216d94 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xee899525 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.427480:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216d94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xee899525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.427505:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216d94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xee899525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.427541:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216d8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.427547:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216d8d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.427554:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216d8d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.427560:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478529.427564:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216d8d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.427571:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216d8d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.427579:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:2.0:1789478529.427581:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478529.427585:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216d8d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.427590:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216d8d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.427638:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216d94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xee899525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.427644:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216d94 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xee899525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.427656:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216d94 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xee899525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.427661:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76c00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478529.427665:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216d94 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xee899525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.427671:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216d94 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xee899525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.427679:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xee899525 (ffff8ebc1046f400) 00010000:00010000:2.0:1789478529.427681:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478529.427684:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216d94 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xee899525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.427690:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216d94 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xee899525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478529.427774:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+67:12458:x1876403945571968:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 465us (635us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789478529.427782:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 237 00000100:00100000:3.0:1789478529.430282:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478529.430793:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945572096 00000100:00100000:2.0:1789478529.430802:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945572096 00000100:00100000:2.0:1789478529.430864:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 238 00000100:00100000:2.0:1789478529.430875:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+67:12458:x1876403945572096:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789478529.431218:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478529.431242:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216d9b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b762e expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.431301:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216da2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.431313:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216da2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.431401:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216da2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.431502:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216d9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b762e expref: 69 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.431520:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216da2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b762e expref: 68 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.431529:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ebc1046f100) 00010000:00010000:2.0:1789478529.431532:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789478529.431535:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f77800, rc 0) 00000100:00100000:2.0:1789478529.431632:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+68:12458:x1876403945572096:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 758us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478529.431639:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 238 00000100:00100000:2.0:1789478529.436146:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478529.436345:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945572352 00000100:00100000:1.0:1789478529.436354:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945572352 00000100:00100000:1.0:1789478529.436411:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 239 00000100:00100000:1.0:1789478529.436422:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+68:12458:x1876403945572352:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789478529.436495:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216da9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.436512:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216da9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.436542:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216da9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789478529.436720:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:1.0:1789478529.436774:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae868cd1 reply state 00000000fc078804 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216da9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.436788:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216da9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.436795:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ebc1046f100) 00010000:00010000:1.0:1789478529.436798:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789478529.436801:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789478529.436904:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+70:12458:x1876403945572352:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 483us (767us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1789478529.436911:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 239 00000100:00100000:1.0:1789478529.440635:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478529.441108:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945572480 00000100:00100000:3.0:1789478529.441118:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945572480 00000100:00100000:3.0:1789478529.441171:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 240 00000100:00100000:3.0:1789478529.441182:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+70:12458:x1876403945572480:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789478529.441203:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478529.441223:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e8216db0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7635 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.441287:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e8216db0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7635 expref: 71 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.441301:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e8216db0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7635 expref: 71 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.441319:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ebc1046f100) 00010000:00010000:3.0:1789478529.441506:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789478529.441510:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fdc00, rc 0) 00000100:00100000:3.0:1789478529.441576:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+71:12458:x1876403945572480:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 395us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478529.441582:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 240 00000100:00100000:2.0:1789478529.446169:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478529.446340:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945572608 00000100:00100000:0.0:1789478529.446349:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945572608 00000100:00100000:0.0:1789478529.446412:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 70 00000100:00100000:0.0:1789478529.446423:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:2395:x1876403945572608:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789478529.446666:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+10:2395:x1876403945572608:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 Request processed in 244us (505us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789478529.446673:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 70 00000100:00100000:1.0:1789478529.450367:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478529.450567:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945572864 00000100:00100000:0.0:1789478529.450576:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945572864 00000100:00100000:0.0:1789478529.450652:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 60 00000100:00100000:0.0:1789478529.450662:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+71:12458:x1876403945572864:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789478529.450869:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+72:12458:x1876403945572864:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 207us (508us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1789478529.450876:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 60 00000100:00100000:2.0:1789478529.454500:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478529.454589:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945573120 00000100:00100000:0.0:1789478529.454618:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945573120 00000100:00100000:0.0:1789478529.454673:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 241 00000100:00100000:0.0:1789478529.454683:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+72:12458:x1876403945573120:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789478529.454799:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+72:12458:x1876403945573120:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 117us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478529.454807:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 241 00000100:00100000:2.0:1789478529.460508:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478529.460582:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945573248 00000100:00100000:3.0:1789478529.460590:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945573248 00000100:00100000:3.0:1789478529.460671:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 242 00000100:00100000:3.0:1789478529.460680:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+72:12458:x1876403945573248:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789478529.460698:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478529.460715:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216db7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b763c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.460790:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216dbe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.460803:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216dbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.460813:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216dbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478529.460850:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789478529.460865:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216dbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.461300:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216db7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b763c expref: 74 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.461438:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216dbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b763c expref: 73 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.461448:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ebc1046f100) 00010000:00010000:3.0:1789478529.461451:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789478529.461454:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fce00, rc 0) 00000100:00100000:3.0:1789478529.461537:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+73:12458:x1876403945573248:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 857us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478529.461544:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 242 00000100:00100000:2.0:1789478529.466212:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478529.466337:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945573376 00000100:00100000:0.0:1789478529.466347:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945573376 00000100:00100000:0.0:1789478529.466434:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 71 00000100:00100000:0.0:1789478529.466445:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+10:2395:x1876403945573376:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789478529.466461:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478529.466481:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e525c7a/0x8ebaae74e8216dc5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7643 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789478529.466505:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa94680, blocks: 0x0 00010000:00010000:0.0:1789478529.466524:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=358s v=(0 0) 00010000:00010000:0.0:1789478529.466528:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478529.466536:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e525c7a/0x8ebaae74e8216dc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7643 expref: 11 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.466554:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e525c7a/0x8ebaae74e8216dc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7643 expref: 11 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.466566:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029df000, rc 0) 00000100:00100000:0.0:1789478529.466652:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+11:2395:x1876403945573376:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 209us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478529.466659:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 71 00000100:00100000:2.0:1789478529.468470:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478529.468535:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945573632 00000100:00100000:1.0:1789478529.468544:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945573632 00000100:00100000:1.0:1789478529.468628:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 243 00000100:00100000:1.0:1789478529.468639:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+73:12458:x1876403945573632:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789478529.468736:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+73:12458:x1876403945573632:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 98us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478529.468743:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 243 00000100:00100000:2.0:1789478529.475894:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478529.476177:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945573760 00000100:00100000:0.0:1789478529.476186:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945573760 00000100:00100000:0.0:1789478529.476254:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 72 00000100:00100000:0.0:1789478529.476266:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0373f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+11:12458:x1876403945573760:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789478529.476282:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478529.476298:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ce5e813/0x8ebaae74e8216dcc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b764a expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.476356:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e525c7a/0x8ebaae74e8216dc5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7643 expref: 12 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.476365:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478529.476369:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478529.476375:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ce5e813/0x8ebaae74e8216dcc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b764a expref: 12 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.476405:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e525c7a/0x8ebaae74e8216dc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7643 expref: 12 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.476419:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e525c7a/0x8ebaae74e8216dc5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7643 expref: 12 pid: 8432 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478529.476434:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1876403964484736:192.168.206.11@tcp:104: 00000100:00100000:0.0:1789478529.476511:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc359b6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789478529.482722:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478529.482843:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1876403964484736:192.168.206.11@tcp:104: 00010000:00010000:0.0:1789478529.482873:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009ce5e813/0x8ebaae74e8216dcc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b764a expref: 12 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.482911:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029df600, rc 0) 00000100:00100000:1.0:1789478529.482949:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945573888 00000100:00100000:1.0:1789478529.482956:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945573888 00000100:00100000:0.0:1789478529.482969:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0373f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+13:12458:x1876403945573760:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 6706us (7083us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478529.482977:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 72 00010000:00010000:1.0:1789478529.482993:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e525c7a/0x8ebaae74e8216dc5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7643 expref: 13 pid: 8432 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478529.483024:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 101 00000100:00100000:1.0:1789478529.484006:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0373e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+12:2396:x1876403945573888:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789478529.484026:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478529.484048:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e525c7a/0x8ebaae74e8216dc5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7643 expref: 12 pid: 8432 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.484063:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e525c7a/0x8ebaae74e8216dc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7643 expref: 12 pid: 8432 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.484092:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e525c7a/0x8ebaae74e8216dc5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7643 expref: 12 pid: 8432 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.484105:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478529.484110:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478529.484117:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009ce5e813/0x8ebaae74e8216dcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b764a expref: 11 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.484126:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ce5e813/0x8ebaae74e8216dcc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b764a expref: 11 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.484157:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009ce5e813/0x8ebaae74e8216dcc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b764a expref: 11 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478529.484169:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f55180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6502:1876403964484864:192.168.206.11@tcp:105: 00000100:00100000:1.0:1789478529.484236:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb010d6780 going to sleep for 11 seconds 00000100:00100000:2.0:1789478529.490083:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478529.490178:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f55180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6502:1876403964484864:192.168.206.11@tcp:105: 00010000:00010000:1.0:1789478529.490198:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478529.490259:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0373e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+11:2396:x1876403945573888:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 7227us (7545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478529.490414:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945574016 00000100:00100000:3.0:1789478529.490420:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945574016 00002000:00100000:3.0:1789478529.490465:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8ebb0373d880 x1876403945574016/t0(0) o4->327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp:190/0 lens 504/0 e 0 to 0 dl 1789478540 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789478529.490487:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ebb0373d880 with x1876403945574016 ext(0->12) 00002000:00010000:3.0:1789478529.490492:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ebb0373d880 00000100:00100000:3.0:1789478529.490522:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00100000:3.0:1789478529.490531:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0373d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+12:2396:x1876403945574016:12345-192.168.206.11@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789478529.492805:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0373d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+14:2396:x1876403945574016:12345-192.168.206.11@tcp:4:lhsmtool_posix.0 Request processed in 2268us (2724us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1789478529.492817:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 6 00002000:00100000:3.0:1789478529.492827:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8ebb0373d880 x1876403945574016/t4294967321(0) o4->327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp:190/0 lens 504/448 e 0 to 0 dl 1789478540 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789478529.492836:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ebb0373d880 with x1876403945574016 ext(0->12) 00002000:00010000:3.0:1789478529.492840:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ebb0373d880 00000100:00100000:1.0:1789478529.493520:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 101 00000100:00100000:2.0:1789478529.496230:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478529.496326:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945574144 00000100:00100000:1.0:1789478529.496335:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945574144 00000100:00100000:1.0:1789478529.496388:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 244 00000100:00100000:1.0:1789478529.496398:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0373dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+73:12458:x1876403945574144:12345-192.168.206.11@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789478529.498807:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:0.0:1789478529.498842:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1789478529.498875:0:6496:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ebb03cb9600 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1789478529.498880:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ebc02b97800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ebb03cb99c0 00000020:00080000:0.0:1789478529.498883:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ebc02b97700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ebc34d77600 00000020:00080000:3.0:1789478529.498926:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789478529.499058:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789478529.499078:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3fca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964484992:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789478529.499136:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478529.499181:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964484992 00000100:00100000:2.0:1789478529.499188:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964484992 00000100:00100000:2.0:1789478529.499237:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789478529.499258:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1876403964484992:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789478529.499298:0:8829:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:2.0:1789478529.499327:0:8829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa94680, atime: 0x6aa94680, ctime: 0x6aa94680, blocks: 0x8 00010000:00010000:2.0:1789478529.499335:0:8829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017f094c7/0x8ebaae74e8216dd3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.499349:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=358s v=(0 0) 00010000:00010000:2.0:1789478529.499353:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478529.499358:0:8829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017f094c7/0x8ebaae74e8216dd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.499377:0:8829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017f094c7/0x8ebaae74e8216dd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.499387:0:8829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017f094c7/0x8ebaae74e8216dd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.499409:0:8829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017f094c7/0x8ebaae74e8216dd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.499426:0:8829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789478529.499546:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3647:x1876403964484992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 301us (409us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789478529.499553:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:2.0:1789478529.499573:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478529.499578:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017f094c7/0x8ebaae74e8216dd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.499586:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76400 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478529.499591:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017f094c7/0x8ebaae74e8216dd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.499623:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017f094c7/0x8ebaae74e8216dd3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.499639:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017f094c7/0x8ebaae74e8216dd3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.499647:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017f094c7/0x8ebaae74e8216dd3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.499664:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478529.499672:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478529.499674:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789478529.499682:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789478529.499712:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ebc3fca9880/2, rc 0, transno 4294967311 00000100:00100000:2.0:1789478529.499718:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3fca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964484992:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789478529.499996:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1789478529.500037:0:6496:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ebb03cd76c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1789478529.500040:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ebc02b97f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ebb03cd7900 00000020:00080000:0.0:1789478529.500043:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ebc02b97300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ebb027da800 00000020:00080000:0.0:1789478529.500062:0:6496:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1789478529.500124:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1789478529.500164:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789478529.500610:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789478529.500622:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964485120:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789478529.500659:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478529.500859:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964485120 00000100:00100000:2.0:1789478529.500865:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964485120 00000100:00100000:2.0:1789478529.501091:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789478529.501102:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876403964485120:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789478529.501123:0:8430:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:2.0:1789478529.501141:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c10a0d4/0x8ebaae74e8216dda lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.501158:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c00e760f/0x8ebaae74e8216b87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75a2 expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.501166:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789478529.501170:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789478529.501174:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c10a0d4/0x8ebaae74e8216dda lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.501197:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c00e760f/0x8ebaae74e8216b87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75a2 expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.501209:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c00e760f/0x8ebaae74e8216b87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75a2 expref: 12 pid: 8430 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478529.501233:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f38380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1876403964485248:192.168.206.11@tcp:104: 00000100:00100000:2.0:1789478529.501307:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb034bff00 going to sleep for 11 seconds 00010000:00010000:1.0:1789478529.503138:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216ad1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503152:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216ad1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503158:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216ad1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503164:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4b600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478529.503168:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216ad1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503174:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216ad1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503189:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ebb024f4100) 00010000:00010000:1.0:1789478529.503192:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478529.503197:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216ad1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503217:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8216ad1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503244:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216b79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503261:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216b79 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503266:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216b79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503271:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67c00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478529.503275:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216b79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503281:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216b79 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503290:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ebb024f4b00) 00010000:00010000:1.0:1789478529.503292:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478529.503295:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216b79 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503300:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67c00/0x8ebaae74e8216b79 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503315:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216bf7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503322:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216bf7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503334:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216bf7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503339:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478529.503342:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216bf7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503349:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216bf7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503358:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ebb02275200) 00010000:00010000:1.0:1789478529.503360:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478529.503363:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216bf7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503369:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216bf7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503380:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e8216c1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503388:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e8216c1a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503393:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e8216c1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503398:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76000 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478529.503400:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e8216c1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503416:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e8216c1a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503426:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ebb02275200) 00010000:00010000:1.0:1789478529.503428:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478529.503430:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e8216c1a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503435:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76000/0x8ebaae74e8216c1a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503450:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216cec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503457:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216cec lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503463:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216cec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503468:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76e00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478529.503470:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216cec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503475:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216cec lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503482:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:1.0:1789478529.503485:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478529.503487:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216cec lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503502:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216cec lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503515:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216da9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503520:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216da9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503525:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216da9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503530:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4ae00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478529.503532:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216da9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503537:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216da9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503545:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ebc1046f100) 00010000:00010000:1.0:1789478529.503547:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789478529.503550:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216da9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.503556:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216da9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478529.504151:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0373dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+21:12458:x1876403945574144:12345-192.168.206.11@tcp:44:lhsmtool_posix.0 Request processed in 7749us (7923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478529.504161:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 244 00000100:00100000:2.0:1789478529.504314:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f38380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1876403964485248:192.168.206.11@tcp:104: 00010000:00010000:2.0:1789478529.504338:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005c10a0d4/0x8ebaae74e8216dda lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478529.504403:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478529.504457:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945574272 00000100:00100000:1.0:1789478529.504464:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945574272 00010000:00010000:1.0:1789478529.504487:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c00e760f/0x8ebaae74e8216b87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75a2 expref: 13 pid: 8430 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478529.504517:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 102 00000100:00100000:1.0:1789478529.504525:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04485f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+13:2396:x1876403945574272:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789478529.504538:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478529.504543:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c00e760f/0x8ebaae74e8216b87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75a2 expref: 13 pid: 8430 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.504555:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c00e760f/0x8ebaae74e8216b87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75a2 expref: 13 pid: 8430 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.504574:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c00e760f/0x8ebaae74e8216b87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75a2 expref: 13 pid: 8430 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.504585:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789478529.504589:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789478529.504619:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005c10a0d4/0x8ebaae74e8216dda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.504629:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c10a0d4/0x8ebaae74e8216dda lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.504654:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478529.504683:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04485f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+12:2396:x1876403945574272:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 159us (280us total) trans 0 rc 0/0 00010000:00010000:2.0:1789478529.504688:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005c10a0d4/0x8ebaae74e8216dda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478529.504690:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 102 00010000:00010000:2.0:1789478529.504697:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c10a0d4/0x8ebaae74e8216dda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.504706:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c10a0d4/0x8ebaae74e8216dda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.504714:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c10a0d4/0x8ebaae74e8216dda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478529.506445:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478529.506586:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945574400 00000100:00100000:1.0:1789478529.506621:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945574400 00000100:00100000:1.0:1789478529.506663:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 75 00000100:00100000:1.0:1789478529.506672:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+12:2398:x1876403945574400:12345-192.168.206.11@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1789478529.508283:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789478529.508295:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c10a0d4/0x8ebaae74e8216dda lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.508306:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77e00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478529.508318:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c10a0d4/0x8ebaae74e8216dda lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.508328:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c10a0d4/0x8ebaae74e8216dda lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.508347:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c10a0d4/0x8ebaae74e8216dda lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.508357:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478529.508358:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478529.508360:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789478529.509010:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:1.0:1789478529.509027:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000100:00100000:3.0:1789478529.509264:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2398:x1876403945574400:12345-192.168.206.11@tcp:16:lhsmtool_posix.0 Request processed in 2588us (2821us total) trans 0 rc 0/0 00010000:00010000:2.0:1789478529.509272:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000100:00100000:3.0:1789478529.509274:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 75 00010000:00010000:2.0:1789478529.509279:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c10a0d4/0x8ebaae74e8216dda lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478529.510128:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876403964485120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9026us (9465us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1789478529.510150:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789478529.510183:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:3.0:1789478529.510189:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:3.0:1789478529.510209:0:3646:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ebb03f38a80 x1876403964485120/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789478545 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789478529.510220:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ebb03f38a80/2, rc 0, transno 4294967322 00000100:00100000:3.0:1789478529.510240:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964485120:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789478529.512128:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478529.512205:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945574656 00000100:00100000:1.0:1789478529.512214:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945574656 00000100:00100000:1.0:1789478529.512280:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 245 00000100:00100000:1.0:1789478529.512289:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+21:12458:x1876403945574656:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789478529.512337:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478529.512361:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216dbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b763c expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.512377:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ebc1046f100) 00010000:00010000:1.0:1789478529.512382:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789478529.512408:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216de1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.512421:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216de1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.512429:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216de1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789478529.512533:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8b35cb3 reply state 0000000071f6e80a transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216de1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.512556:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216de1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.512563:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ebc1046f100) 00010000:00010000:1.0:1789478529.512565:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789478529.512568:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789478529.512687:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+22:12458:x1876403945574656:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 398us (565us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1789478529.512694:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 245 00000100:00100000:0.0:1789478529.515034:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478529.515241:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945574784 00000100:00100000:3.0:1789478529.515260:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945574784 00000100:00100000:3.0:1789478529.515314:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 76 00000100:00100000:3.0:1789478529.515325:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3cb75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2395:x1876403945574784:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789478529.515443:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789478529.515455:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789478528 00002000:00010000:3.0:1789478529.515457:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789478528 00002000:00010000:3.0:1789478529.515459:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789478528 -> 1789478528 00002000:00010000:3.0:1789478529.515462:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789478529.515514:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3cb75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2395:x1876403945574784:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 Request processed in 191us (486us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789478529.515521:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 76 00000100:00100000:0.0:1789478529.521295:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478529.521377:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945575040 00000100:00100000:3.0:1789478529.521387:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945575040 00000100:00100000:3.0:1789478529.521447:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 246 00000100:00100000:3.0:1789478529.521456:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+22:12458:x1876403945575040:12345-192.168.206.11@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789478529.521518:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216de8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.521534:0:13638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216da2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b762e expref: 22 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.521542:0:13638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216de8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.521576:0:13638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216da2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b762e expref: 22 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.521589:0:13638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216da2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b762e expref: 22 pid: 10096 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478529.521641:0:13638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04486d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13638:1876403964485376:192.168.206.11@tcp:104: 00000100:00100000:3.0:1789478529.521710:0:13638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03cb9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478529.524696:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478529.524801:0:13638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04486d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13638:1876403964485376:192.168.206.11@tcp:104: 00010000:00010000:3.0:1789478529.524837:0:13638:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216de8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478529.525057:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945575168 00000100:00100000:2.0:1789478529.525064:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945575168 00010000:00010000:2.0:1789478529.525099:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216da2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b762e expref: 23 pid: 10096 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478529.525136:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 103 00000100:00100000:2.0:1789478529.525145:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+23:2395:x1876403945575168:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789478529.525158:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478529.525166:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216da2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b762e expref: 23 pid: 10096 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.525176:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216da2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b762e expref: 23 pid: 10096 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.525196:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216da2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b762e expref: 23 pid: 10096 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.525210:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ebc1046f100) 00010000:00010000:2.0:1789478529.525214:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216de8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.525221:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216de8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.525228:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216de8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.525280:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478529.525339:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+22:2395:x1876403945575168:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 194us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478529.525347:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 103 00010000:00010000:3.0:1789478529.525689:0:13638:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216de8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.525697:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216de8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.525732:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216de8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.525739:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216de8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.525745:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216de8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.525750:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478529.525754:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216de8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.525778:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216de8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.525787:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ebc1046f100) 00010000:00010000:3.0:1789478529.525790:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789478529.525794:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216de8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.525800:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216de8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478529.525877:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+21:12458:x1876403945575040:12345-192.168.206.11@tcp:55:lhsmtool_posix.0 Request processed in 4422us (4590us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789478529.525886:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 246 00000100:00100000:0.0:1789478529.530006:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478529.530077:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945575296 00000100:00100000:3.0:1789478529.530086:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945575296 00000100:00100000:3.0:1789478529.530153:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 77 00000100:00100000:3.0:1789478529.530163:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2396:x1876403945575296:12345-192.168.206.11@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789478529.530205:0:8829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000082696efe/0x8ebaae74e8216def lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.530225:0:8829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009ce5e813/0x8ebaae74e8216dcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b764a expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.530233:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478529.530237:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789478529.530242:0:8829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082696efe/0x8ebaae74e8216def lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.530287:0:8829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009ce5e813/0x8ebaae74e8216dcc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b764a expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.530301:0:8829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009ce5e813/0x8ebaae74e8216dcc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b764a expref: 8 pid: 8431 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478529.530315:0:8829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04486d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8829:1876403964485504:192.168.206.11@tcp:104: 00000100:00100000:3.0:1789478529.530402:0:8829:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03cb9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478529.534080:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478529.534230:0:8829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04486d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8829:1876403964485504:192.168.206.11@tcp:104: 00010000:00010000:3.0:1789478529.534266:0:8829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000082696efe/0x8ebaae74e8216def lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478529.534417:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945575424 00000100:00100000:0.0:1789478529.534424:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945575424 00010000:00010000:0.0:1789478529.534458:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009ce5e813/0x8ebaae74e8216dcc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b764a expref: 9 pid: 8431 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478529.534496:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 104 00000100:00100000:0.0:1789478529.534505:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+9:2395:x1876403945575424:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478529.534518:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478529.534536:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009ce5e813/0x8ebaae74e8216dcc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b764a expref: 9 pid: 8431 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.534547:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009ce5e813/0x8ebaae74e8216dcc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b764a expref: 9 pid: 8431 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.534582:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ce5e813/0x8ebaae74e8216dcc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b764a expref: 9 pid: 8431 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.534624:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789478529.534629:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789478529.534634:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082696efe/0x8ebaae74e8216def lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.534643:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082696efe/0x8ebaae74e8216def lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.534667:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478529.534720:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2395:x1876403945575424:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 215us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478529.534727:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 104 00010000:00010000:3.0:1789478529.534854:0:8829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000082696efe/0x8ebaae74e8216def lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.534863:0:8829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082696efe/0x8ebaae74e8216def lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.534880:0:8829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000082696efe/0x8ebaae74e8216def lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.534887:0:8829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082696efe/0x8ebaae74e8216def lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.534895:0:8829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082696efe/0x8ebaae74e8216def lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.534902:0:8829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fce00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478529.534906:0:8829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082696efe/0x8ebaae74e8216def lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.534914:0:8829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082696efe/0x8ebaae74e8216def lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.534938:0:8829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082696efe/0x8ebaae74e8216def lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.534946:0:8829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082696efe/0x8ebaae74e8216def lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478529.534989:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2396:x1876403945575296:12345-192.168.206.11@tcp:1:lhsmtool_posix.0 Request processed in 4827us (4991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478529.534997:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 77 00000100:00100000:1.0:1789478529.537558:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478529.537977:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945575680 00000100:00100000:2.0:1789478529.537986:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945575680 00000100:00100000:2.0:1789478529.538085:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 247 00000100:00100000:2.0:1789478529.538095:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+21:12458:x1876403945575680:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789478529.538285:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216df6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.538302:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216ce5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75f6 expref: 21 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.538313:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216df6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.538346:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75f6 expref: 21 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.538360:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216ce5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75f6 expref: 21 pid: 13638 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478529.538374:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f38380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964485632:192.168.206.11@tcp:104: 00000100:00100000:2.0:1789478529.538450:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb034bf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478529.541422:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478529.541814:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945575808 00000100:00100000:0.0:1789478529.541822:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945575808 00010000:00010000:0.0:1789478529.541875:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216ce5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75f6 expref: 22 pid: 13638 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478529.541913:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 105 00000100:00100000:0.0:1789478529.541923:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04486d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+22:2395:x1876403945575808:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478529.541935:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478529.541942:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216ce5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75f6 expref: 22 pid: 13638 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.541971:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216ce5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75f6 expref: 22 pid: 13638 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.541992:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:0.0:1789478529.541998:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216d47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7619 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.542007:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216df6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.542014:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216df6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.542021:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216df6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.542036:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478529.542088:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04486d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+22:2395:x1876403945575808:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 166us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478529.542387:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 105 00010000:00010000:2.0:1789478529.543561:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df400/0x8ebaae74e8216ce5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b75f6 expref: 21 pid: 13638 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478529.543712:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f38380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964485632:192.168.206.11@tcp:104: 00010000:00010000:2.0:1789478529.543734:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216df6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.543743:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216df6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.543812:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216df6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.544092:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216dfd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.544189:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e8216db0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7635 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.544198:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216dfd lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.544228:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e8216db0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7635 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.544242:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e8216db0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7635 expref: 21 pid: 6518 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478529.544267:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f38380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964485760:192.168.206.11@tcp:104: 00000100:00100000:2.0:1789478529.544385:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb034bf600 going to sleep for 11 seconds 00000100:00100000:3.0:1789478529.547071:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478529.547154:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945575936 00000100:00100000:0.0:1789478529.547162:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945575936 00010000:00010000:0.0:1789478529.547197:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e8216db0 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7635 expref: 22 pid: 6518 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478529.547239:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 106 00000100:00100000:0.0:1789478529.547280:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08342c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+22:2395:x1876403945575936:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478529.547307:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478529.547315:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e8216db0 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7635 expref: 22 pid: 6518 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.547327:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e8216db0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7635 expref: 22 pid: 6518 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.547349:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ebc1046f100) 00010000:00010000:0.0:1789478529.547354:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216dfd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.547363:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216dfd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.547370:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216dfd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.547386:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478529.547439:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08342c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+22:2395:x1876403945575936:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 191us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478529.547447:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 106 00010000:00010000:2.0:1789478529.550992:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e8216db0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7635 expref: 21 pid: 6518 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478529.551017:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f38380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964485760:192.168.206.11@tcp:104: 00010000:00010000:2.0:1789478529.551547:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216dfd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.551559:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216dfd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.551565:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216dfd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789478529.551703:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1789478529.551838:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1789478529.551883:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1789478529.551962:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f38380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6519:1876403964485888:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789478529.552021:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478529.552047:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb034bf900 going to sleep for 11 seconds 00000100:00100000:0.0:1789478529.553540:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964485888 00000100:00100000:0.0:1789478529.553551:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964485888 00000100:00100000:0.0:1789478529.553639:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789478529.553649:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6519:x1876403964485888:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789478529.553763:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6519:x1876403964485888:12345-0@lo:1000:mdt00_002.0 Request processed in 115us (1741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478529.553770:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789478529.553892:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f38380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6519:1876403964485888:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789478529.554019:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1789478529.554088:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6519:1876403964486016:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789478529.554126:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478529.554159:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb010d6480 going to sleep for 11 seconds 00000100:00100000:0.0:1789478529.554321:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964486016 00000100:00100000:0.0:1789478529.554326:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964486016 00000100:00100000:0.0:1789478529.554358:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789478529.554366:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6519:x1876403964486016:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789478529.554462:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6519:x1876403964486016:12345-0@lo:1000:mdt00_002.0 Request processed in 97us (335us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1789478529.554469:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789478529.554548:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6519:1876403964486016:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789478529.554581:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216dfd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.554590:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216dfd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.554630:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216dfd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.554636:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77e00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478529.554649:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216dfd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.554657:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216dfd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.554673:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ebc1046f100) 00010000:00010000:1.0:1789478529.554676:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789478529.554680:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216dfd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.554686:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77e00/0x8ebaae74e8216dfd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.554707:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8216d40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.554714:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8216d40 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.554720:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8216d40 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.554725:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4b800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478529.554728:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8216d40 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.554733:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8216d40 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.554740:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:1.0:1789478529.554743:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789478529.554767:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216d47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7619 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.554778:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216d47 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7619 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.554787:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216d47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7619 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.554814:0:6519:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216d47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7619 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478529.554825:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f54e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964486144:192.168.206.11@tcp:105: 00000100:00100000:1.0:1789478529.554981:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb010d6480 going to sleep for 11 seconds 00000100:00100000:0.0:1789478529.559412:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478529.559481:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945576064 00000100:00100000:3.0:1789478529.559489:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945576064 00000100:00100000:3.0:1789478529.559541:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 61 00000100:00100000:3.0:1789478529.559551:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+25:12457:x1876403945576064:12345-192.168.206.11@tcp:49:lfs.0 00000100:00100000:3.0:1789478529.559698:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+25:12457:x1876403945576064:12345-192.168.206.11@tcp:49:lfs.0 Request processed in 148us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478529.559705:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 61 00000100:00100000:1.0:1789478529.562446:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f54e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1876403964486144:192.168.206.11@tcp:105: 00010000:00010000:1.0:1789478529.562474:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8216d40 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.562483:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8216d40 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.562516:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216e04 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.562529:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216e04 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.562540:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216e04 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.562567:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216e04 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.562574:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216e04 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.562579:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216e04 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.562585:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4b200 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478529.562588:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216e04 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.562618:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216e04 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.562630:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:1.0:1789478529.562633:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478529.562636:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216e04 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.562651:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8216e04 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.562663:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216df6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.562668:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216df6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.562673:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216df6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.562685:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478529.562688:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216df6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.562694:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216df6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.562703:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:1.0:1789478529.562706:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789478529.562708:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216df6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478529.562714:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f77800/0x8ebaae74e8216df6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478529.562948:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+24:12458:x1876403945575680:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 24853us (25395us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1789478529.562957:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 247 00000020:00080000:1.0:1789478529.562962:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789478529.563136:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789478529.563141:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789478529.563670:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789478529.563678:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789478529.565365:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478529.567163:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478529.567352:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945576576 00000100:00100000:3.0:1789478529.567362:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945576576 00000100:00100000:3.0:1789478529.567412:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 62 00000100:00100000:3.0:1789478529.567422:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc0838c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+24:12458:x1876403945576576:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789478529.567682:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789478529.567714:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1789478529.567772:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216e0b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.567786:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216e0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.567795:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216e0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.567803:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216e0b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.567808:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216e0b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.567814:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216e0b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.567836:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789478529.568067:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945576320 00000100:00100000:2.0:1789478529.568074:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945576320 00000100:00100000:2.0:1789478529.568112:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 248 00000100:00100000:2.0:1789478529.568120:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+27:12457:x1876403945576320:12345-192.168.206.11@tcp:58:lfs.0 00000100:00100000:3.0:1789478529.568143:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc0838c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+27:12458:x1876403945576576:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 720us (985us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1789478529.568152:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 62 00000020:00080000:3.0:1789478529.568157:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1789478529.568228:0:10096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1789478529.568280:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+26:12457:x1876403945576320:12345-192.168.206.11@tcp:58:lfs.0 Request processed in 160us (2920us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478529.568294:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 248 00010000:00010000:0.0:1789478529.570088:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789478529.570108:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216e0b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.570117:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd800 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:0.0:1789478529.570121:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216e0b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.570129:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216e0b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.570144:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ebc1046f100) 00010000:00010000:0.0:1789478529.570147:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789478529.570150:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216e0b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.570156:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216e0b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.570168:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478529.570170:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478529.570183:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478529.572764:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478529.587517:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478529.587631:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945576704 00000100:00100000:3.0:1789478529.587640:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945576704 00000100:00100000:3.0:1789478529.587703:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 249 00000100:00100000:3.0:1789478529.587714:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+26:12460:x1876403945576704:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1789478529.587739:0:13638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478529.587770:0:13638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216e12 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7651 expref: -99 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.587866:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216e19 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.587880:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216e19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.587891:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216e19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.587906:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216e20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.587914:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216e20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.587921:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216e20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.587997:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216e27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.588008:0:13638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216d32 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7612 expref: 27 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.588016:0:13638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216e27 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.588051:0:13638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216d32 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7612 expref: 27 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478529.588078:0:13638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216d32 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7612 expref: 27 pid: 6517 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478529.588092:0:13638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04487100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13638:1876403964486272:192.168.206.11@tcp:104: 00000100:00100000:3.0:1789478529.588173:0:13638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03cb9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789478529.593646:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478529.593717:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945576960 00000100:00100000:1.0:1789478529.593726:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945576960 00000100:00100000:1.0:1789478529.593792:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 63 00000100:00100000:1.0:1789478529.593804:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+28:6162:x1876403945576960:12345-192.168.206.11@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789478529.594022:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+29:6162:x1876403945576960:12345-192.168.206.11@tcp:35:ldlm_bl.0 Request processed in 220us (383us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1789478529.594031:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 63 00000100:00100000:0.0:1789478529.594656:0:13638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04487100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13638:1876403964486272:192.168.206.11@tcp:104: 00010000:00010000:0.0:1789478529.594680:0:13638:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216e27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478529.597502:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478529.597627:0:10392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945577088 00000100:00100000:2.0:1789478529.597637:0:10392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945577088 00010000:00010000:2.0:1789478529.597682:0:10392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216d32 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7612 expref: 29 pid: 6517 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478529.597723:0:10392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 107 00000100:00100000:2.0:1789478529.597732:0:10392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+29:2395:x1876403945577088:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789478529.597745:0:10392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478529.597752:0:10392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216d32 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7612 expref: 29 pid: 6517 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.597765:0:10392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216d32 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7612 expref: 29 pid: 6517 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.597785:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176c00/0x8ebaae74e8216d32 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7612 expref: 29 pid: 6517 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.597811:0:10392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:2.0:1789478529.597817:0:10392:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216e27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.597825:0:10392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216e27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.597833:0:10392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216e27 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478529.597871:0:10392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789478529.597923:0:13638:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216e27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478529.597932:0:10392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+28:2395:x1876403945577088:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 198us (445us total) trans 0 rc 0/0 00010000:00010000:0.0:1789478529.597934:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216e27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478529.597944:0:10392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 107 00000004:00200000:0.0:1789478529.597986:0:13638:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789478529.597991:0:13638:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789478529.598009:0:13638:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216e27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.598022:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216e27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.598031:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216e19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.598037:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216e19 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.598044:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216e19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.598050:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fce00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478529.598054:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216e19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.598084:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216e19 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.598094:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:0.0:1789478529.598314:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478529.598320:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216e19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.598326:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fce00/0x8ebaae74e8216e19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.598339:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216e20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.598345:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216e20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.598351:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216e20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.598356:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478529.598359:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216e20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.598364:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216e20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.598372:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ebc02c13300) 00010000:00010000:0.0:1789478529.598375:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478529.598377:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216e20 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.598394:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd400/0x8ebaae74e8216e20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.598431:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd600/0x8ebaae74e8216e12 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7651 expref: 28 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.598445:0:13638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216e27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7651 expref: 27 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478529.598452:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:0.0:1789478529.598455:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789478529.598457:0:13638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fca00, rc 0) 00000100:00100000:0.0:1789478529.598498:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+27:12460:x1876403945576704:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 10786us (10991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478529.598504:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 249 00000040:00080000:3.0:1789478530.174686:0:14802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789478530.174694:0:14802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789478530.174726:0:14802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789478530.174732:0:14802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789478530.596923:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789478530.596931:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789478530.596980:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789478530.596988:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789478530.597106:0:13792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f54e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876403964486400:192.168.206.11@tcp:107:hsm_cdtr.0 00010000:00010000:3.0:1789478530.597709:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478530.597928:0:13792:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb034bf900 going to sleep for 11 seconds 00000100:00100000:3.0:1789478530.601412:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478530.601656:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945577216 00000100:00100000:2.0:1789478530.601665:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945577216 00000100:00100000:2.0:1789478530.601755:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 250 00000100:00100000:2.0:1789478530.601766:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+28:12473:x1876403945577216:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789478530.601801:0:6519:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789478530.601917:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+28:12473:x1876403945577216:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 152us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478530.601924:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 250 00000100:00080000:0.0:1789478530.603031:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789478530.604181:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478530.604716:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945577472 00000100:00100000:2.0:1789478530.604726:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945577472 00000100:00100000:2.0:1789478530.604789:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 251 00000100:00100000:2.0:1789478530.604799:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc10183850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+28:12473:x1876403945577472:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789478530.604814:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478530.604831:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216e2e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7658 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478530.605027:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216e35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478530.605041:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216e35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478530.605051:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216e35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478530.605077:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000100:00100000:1.0:1789478530.606207:0:13792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f54e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876403964486400:192.168.206.11@tcp:107:hsm_cdtr.0 00010000:00010000:2.0:1789478530.606478:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76800/0x8ebaae74e8216e2e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7658 expref: 30 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478530.606498:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216e35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7658 expref: 29 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478530.606507:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:2.0:1789478530.606510:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789478530.606513:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76c00, rc 0) 00000100:00100000:2.0:1789478530.606576:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc10183850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+29:12473:x1876403945577472:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 1778us (2398us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1789478530.606584:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 251 00000100:00100000:3.0:1789478530.610735:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478530.610844:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945577600 00000100:00100000:0.0:1789478530.610853:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945577600 00000100:00100000:0.0:1789478530.610911:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:0.0:1789478530.610922:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04485880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+29:2395:x1876403945577600:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478530.610935:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478530.610958:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76c00/0x8ebaae74e8216e35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7658 expref: 29 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478530.610977:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:0.0:1789478530.610993:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478530.611140:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04485880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+28:2395:x1876403945577600:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 220us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478530.611149:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:1.0:1789478530.613499:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478530.613640:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945577856 00000100:00100000:0.0:1789478530.613650:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945577856 00000100:00100000:0.0:1789478530.613703:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 252 00000100:00100000:0.0:1789478530.613712:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+28:12473:x1876403945577856:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789478530.613984:0:13638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e8216e43 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478530.614001:0:13638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e8216e43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478530.614011:0:13638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e8216e43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478530.614316:0:13638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e8216e43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478530.614324:0:13638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e8216e43 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478530.614330:0:13638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e8216e43 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478530.614336:0:13638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029dee00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478530.614340:0:13638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e8216e43 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478530.614347:0:13638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e8216e43 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478530.614371:0:13638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:0.0:1789478530.614374:0:13638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789478530.614379:0:13638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e8216e43 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478530.614385:0:13638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dee00/0x8ebaae74e8216e43 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13638 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478530.614674:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+29:12473:x1876403945577856:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 959us (1178us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1789478530.614684:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 252 00000040:00080000:1.0:1789478530.615327:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789478530.615384:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789478530.616084:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789478530.616093:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789478530.616923:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478530.617079:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945578112 00000100:00100000:2.0:1789478530.617088:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945578112 00000100:00100000:2.0:1789478530.617138:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 64 00000100:00100000:2.0:1789478530.617148:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+29:12473:x1876403945578112:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789478530.617346:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+30:12473:x1876403945578112:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 199us (427us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1789478530.617353:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 64 00000100:00100000:2.0:1789478530.789355:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789478530.789378:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964486528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789478530.789509:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478530.789664:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964486528 00000100:00100000:0.0:1789478530.789671:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964486528 00000100:00100000:0.0:1789478530.789716:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789478530.789724:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876403964486528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789478530.789748:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478530.789829:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876403964486528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478530.789837:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789478530.789899:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964486528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789478531.198433:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478531.198548:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945578240 00000100:00100000:1.0:1789478531.198557:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945578240 00000100:00100000:1.0:1789478531.198650:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 379 00000100:00100000:1.0:1789478531.198661:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2396:x1876403945578240:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478531.198800:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2396:x1876403945578240:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 140us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478531.198808:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 379 00000100:00100000:3.0:1789478531.200584:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478531.201430:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478531.201468:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478531.201501:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945578368 00000100:00100000:2.0:1789478531.201523:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945578368 00000100:00100000:2.0:1789478531.201572:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945578880 00000100:00100000:2.0:1789478531.201576:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945578880 00000100:00100000:2.0:1789478531.201651:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 280 00000100:00100000:2.0:1789478531.201659:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+30:2396:x1876403945578368:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1789478531.201727:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+30:2396:x1876403945578368:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 69us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478531.201735:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 280 00000100:00100000:2.0:1789478531.201761:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 281 00000100:00100000:2.0:1789478531.201769:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2395:x1876403945578880:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1789478531.201799:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2395:x1876403945578880:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 32us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478531.201810:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 281 00000100:00100000:3.0:1789478531.201814:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478531.201868:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945578624 00000100:00100000:0.0:1789478531.201873:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945578624 00000100:00100000:0.0:1789478531.201907:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 138 00000100:00100000:0.0:1789478531.201915:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945578624:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478531.201945:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945578624:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 32us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478531.201951:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 138 00000100:00080000:0.0:1789478531.201996:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789478531.202001:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789478531.202098:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478531.202133:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478531.202412:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945578496 00000100:00100000:2.0:1789478531.202418:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945578496 00000100:00100000:2.0:1789478531.202445:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 282 00000100:00100000:2.0:1789478531.202452:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945578496:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1789478531.202848:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2395:x1876403945578496:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 394us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478531.202856:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 282 00000100:00080000:2.0:1789478531.202875:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789478531.202909:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945578752 00000100:00100000:2.0:1789478531.202913:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945578752 00000100:00100000:2.0:1789478531.202942:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 139 00000100:00100000:2.0:1789478531.202950:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2395:x1876403945578752:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1789478531.203047:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2395:x1876403945578752:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 97us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478531.203061:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 139 00000100:00080000:2.0:1789478531.203077:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789478531.209956:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945579008 00000100:00100000:1.0:1789478531.209969:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945579008 00000100:00100000:1.0:1789478531.210048:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 283 00000100:00100000:1.0:1789478531.210058:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2395:x1876403945579008:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478531.210133:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2395:x1876403945579008:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 77us (8000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478531.210141:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 283 00000100:00080000:3.0:1789478531.212967:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789478531.301160:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789478531.301188:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964486656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789478531.301261:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478531.301392:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964486656 00000100:00100000:2.0:1789478531.301399:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964486656 00000100:00100000:2.0:1789478531.301462:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789478531.301472:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964486656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789478531.301492:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789478531.301534:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964486656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478531.301542:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1789478531.301651:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789478531.301681:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964486656:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789478531.620976:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789478531.948831:0:14853:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789478531.948840:0:14853:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789478531.948875:0:14853:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789478531.948882:0:14853:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789478532.049655:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478532.051958:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945579264 00000100:00100000:0.0:1789478532.051971:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945579264 00000100:00100000:0.0:1789478532.052045:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 253 00000100:00100000:0.0:1789478532.052056:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+30:12493:x1876403945579264:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1789478532.052073:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478532.052091:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df600/0x8ebaae74e8216e4a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b765f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478532.052184:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216e51 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478532.052198:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216e51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478532.052210:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216e51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789478532.052220:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789478532.052322:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df600/0x8ebaae74e8216e4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b765f expref: 33 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478532.052339:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216e51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b765f expref: 32 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478532.052347:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:0.0:1789478532.052350:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789478532.052353:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029df000, rc 0) 00000100:00100000:0.0:1789478532.052421:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+32:12493:x1876403945579264:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 366us (2774us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1789478532.052428:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 253 00000100:00080000:3.0:1789478532.053146:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789478532.056943:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478532.057280:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945579392 00000100:00100000:2.0:1789478532.057289:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945579392 00000100:00100000:2.0:1789478532.057345:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 254 00000100:00100000:2.0:1789478532.057355:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+32:12493:x1876403945579392:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:2.0:1789478532.057413:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216e5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478532.057429:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216e5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478532.057439:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216e5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478532.057471:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216e5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478532.057478:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216e5f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478532.057496:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216e5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478532.057502:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76e00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478532.057506:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216e5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478532.057513:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216e5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478532.057524:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:2.0:1789478532.057527:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789478532.057531:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216e5f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478532.057536:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76e00/0x8ebaae74e8216e5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478532.057627:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+32:12493:x1876403945579392:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 273us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478532.057635:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 254 00000100:00100000:0.0:1789478532.118186:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478532.119562:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945579520 00000100:00100000:1.0:1789478532.119574:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945579520 00000100:00100000:1.0:1789478532.119659:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 78 00000100:00100000:1.0:1789478532.119670:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2395:x1876403945579520:12345-192.168.206.11@tcp:101:cat.0 00010000:00010000:1.0:1789478532.119687:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478532.119706:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d96df3c7/0x8ebaae74e8216e66 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7666 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789478532.119730:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa94680, atime: 0x6aa94680, ctime: 0x6aa94680, blocks: 0x8 00010000:00010000:1.0:1789478532.119749:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=361s v=(0 0) 00010000:00010000:1.0:1789478532.119753:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478532.119762:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d96df3c7/0x8ebaae74e8216e66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7666 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478532.119781:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d96df3c7/0x8ebaae74e8216e66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7666 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478532.119794:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4bc00, rc 0) 00000100:00100000:1.0:1789478532.119849:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2395:x1876403945579520:12345-192.168.206.11@tcp:101:cat.0 Request processed in 180us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478532.119856:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 78 00000100:00100000:2.0:1789478532.128257:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478532.130983:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945579648 00000100:00100000:1.0:1789478532.130997:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945579648 00002000:00100000:1.0:1789478532.131051:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8ebb03f39500 x1876403945579648/t0(0) o3->327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp:193/0 lens 488/0 e 0 to 0 dl 1789478543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789478532.131063:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ebb03f39500 with x1876403945579648 ext(0->4095) 00002000:00010000:1.0:1789478532.131083:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ebb03f39500 00000100:00100000:1.0:1789478532.131113:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:1.0:1789478532.131123:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2395:x1876403945579648:12345-192.168.206.11@tcp:3:cat.0 00000100:00100000:1.0:1789478532.131302:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+8:2395:x1876403945579648:12345-192.168.206.11@tcp:3:cat.0 Request processed in 168us (3038us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789478532.131311:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 7 00002000:00100000:1.0:1789478532.131318:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8ebb03f39500 x1876403945579648/t0(0) o3->327dd6d5-45fd-4b52-99bf-74d27d1ede6e@192.168.206.11@tcp:193/0 lens 488/4536 e 0 to 0 dl 1789478543 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789478532.131326:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ebb03f39500 with x1876403945579648 ext(0->4095) 00002000:00010000:1.0:1789478532.131329:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ebb03f39500 00010000:00010000:2.0:1789478532.644935:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478532.839809:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964486784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789478532.839892:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478532.839971:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964486784 00000100:00100000:0.0:1789478532.839978:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964486784 00000100:00100000:0.0:1789478532.840021:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789478532.840040:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964486784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789478532.840074:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789478532.840117:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964486784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478532.840124:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789478532.840165:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964486784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789478532.842285:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876403964487040:0@lo:400:kworker.0 00000100:00100000:3.0:1789478532.842343:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478532.842376:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876403964487552:0@lo:400:kworker.0 00000100:00100000:3.0:1789478532.842398:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478532.842417:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876403964488064:0@lo:400:kworker.0 00000100:00100000:3.0:1789478532.842436:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478532.842456:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789478532.842462:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964486912:0@lo:400:kworker.0 00000100:00100000:3.0:1789478532.842487:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478532.842512:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876403964487424:0@lo:400:kworker.0 00000100:00100000:3.0:1789478532.842532:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478532.842548:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876403964487936:0@lo:400:kworker.0 00000100:00100000:3.0:1789478532.842568:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478532.842610:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964487168:0@lo:400:kworker.0 00000100:00100000:3.0:1789478532.842640:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478532.842658:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964487680:0@lo:400:kworker.0 00000100:00100000:3.0:1789478532.842679:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478532.842697:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964488192:0@lo:400:kworker.0 00000100:00100000:3.0:1789478532.842735:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478532.842755:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789478532.842761:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964487296:0@lo:400:kworker.0 00000100:00100000:3.0:1789478532.842782:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478532.842791:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964487808:0@lo:400:kworker.0 00000100:00100000:3.0:1789478532.842809:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478532.842825:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964488320:0@lo:400:kworker.0 00000100:00100000:1.0:1789478532.843080:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964487040 00000100:00100000:1.0:1789478532.843087:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964487040 00000100:00100000:1.0:1789478532.843121:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964487552 00000100:00100000:1.0:1789478532.843124:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964487552 00000100:00100000:1.0:1789478532.843147:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964488064 00000100:00100000:1.0:1789478532.843149:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964488064 00000100:00100000:1.0:1789478532.843160:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964487424 00000100:00100000:1.0:1789478532.843163:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964487424 00000100:00100000:1.0:1789478532.843174:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964487936 00000100:00100000:1.0:1789478532.843176:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964487936 00000100:00100000:1.0:1789478532.843187:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964487296 00000100:00100000:1.0:1789478532.843189:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964487296 00000100:00100000:1.0:1789478532.843204:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789478532.843211:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876403964487040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478532.843284:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876403964487040:12345-0@lo:400:kworker.0 Request processed in 72us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478532.843292:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789478532.843308:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789478532.843322:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876403964487552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478532.843353:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876403964487552:12345-0@lo:400:kworker.0 Request processed in 32us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478532.843359:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789478532.843371:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789478532.843377:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876403964488064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478532.843403:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876403964488064:12345-0@lo:400:kworker.0 Request processed in 28us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478532.843409:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789478532.843419:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789478532.843425:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876403964487424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478532.843450:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876403964487424:12345-0@lo:400:kworker.0 Request processed in 26us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478532.843456:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789478532.843466:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1789478532.843471:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876403964487936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478532.843495:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876403964487936:12345-0@lo:400:kworker.0 Request processed in 24us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478532.843500:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1789478532.843511:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789478532.843517:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964487296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478532.843542:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964487296:12345-0@lo:400:kworker.0 Request processed in 26us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478532.843547:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789478532.843904:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478532.843954:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964487296:0@lo:400:kworker.0 00000100:00100000:3.0:1789478532.843991:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964486912 00000100:00100000:3.0:1789478532.843995:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964486912 00000100:00100000:3.0:1789478532.844023:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1789478532.844374:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964487680 00000100:00100000:0.0:1789478532.844379:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964487680 00000100:00100000:0.0:1789478532.844404:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964488192 00000100:00100000:0.0:1789478532.844407:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964488192 00000100:00100000:0.0:1789478532.844423:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964487808 00000100:00100000:0.0:1789478532.844425:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964487808 00000100:00100000:0.0:1789478532.844437:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964488320 00000100:00100000:0.0:1789478532.844439:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964488320 00000100:00100000:0.0:1789478532.844450:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789478532.844457:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964487680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478532.844502:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964487680:12345-0@lo:400:kworker.0 Request processed in 46us (1822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478532.844519:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789478532.844534:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789478532.844540:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964488192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478532.844569:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964488192:12345-0@lo:400:kworker.0 Request processed in 30us (1834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478532.844575:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789478532.844586:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789478532.844614:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1876403964487808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478532.844643:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1876403964487808:12345-0@lo:400:kworker.0 Request processed in 51us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478532.844648:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789478532.844659:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789478532.844664:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1876403964488320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478532.844688:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1876403964488320:12345-0@lo:400:kworker.0 Request processed in 23us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478532.844696:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789478532.845355:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3646:x1876403964486912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478532.845398:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3646:x1876403964486912:12345-0@lo:400:kworker.0 Request processed in 1368us (2910us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478532.845405:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1789478532.845447:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964487168 00000100:00100000:3.0:1789478532.845453:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964487168 00000100:00100000:3.0:1789478532.845491:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789478532.845498:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964487168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478532.845529:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964487168:12345-0@lo:400:kworker.0 Request processed in 32us (2887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478532.845535:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:3.0:1789478532.845560:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789478532.845564:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789478532.845566:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789478532.845577:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789478532.845624:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964486912:0@lo:400:kworker.0 00000100:00100000:3.0:1789478532.845640:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876403964487424:0@lo:400:kworker.0 00000100:00100000:3.0:1789478532.845651:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876403964487936:0@lo:400:kworker.0 00000100:00100000:3.0:1789478532.845663:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876403964487040:0@lo:400:kworker.0 00010000:00080000:3.0:1789478532.845677:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb04485f80 x1876403964487552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478532.845688:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876403964487552:0@lo:400:kworker.0 00010000:00080000:3.0:1789478532.845699:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc08884000 x1876403964488064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478532.845705:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876403964488064:0@lo:400:kworker.0 00000100:00100000:3.0:1789478532.847419:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964487808:0@lo:400:kworker.0 00000100:00100000:3.0:1789478532.847437:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964488320:0@lo:400:kworker.0 00000100:00100000:3.0:1789478532.847448:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964487168:0@lo:400:kworker.0 00000100:00100000:3.0:1789478532.847459:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964487680:0@lo:400:kworker.0 00000100:00100000:3.0:1789478532.847470:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964488192:0@lo:400:kworker.0 00000100:00100000:3.0:1789478532.853928:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789478532.853951:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964488448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789478532.854011:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478532.854059:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964488448 00000100:00100000:3.0:1789478532.854066:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964488448 00000100:00100000:3.0:1789478532.854115:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789478532.854125:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964488448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789478532.854157:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789478532.854202:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964488448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478532.854209:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789478532.854267:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964488448:0@lo:41:osp-pre-0-1.0 00000004:00080000:1.0:1789478533.351045:0:9999:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362466449157ns, next at 363466446179ns, rc = 0 00000100:00100000:2.0:1789478533.351120:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964488576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789478533.351183:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478533.351288:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964488576 00000100:00100000:1.0:1789478533.351296:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964488576 00000100:00100000:1.0:1789478533.351421:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789478533.351431:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876403964488576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789478533.351459:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789478533.351505:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876403964488576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478533.351512:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789478533.351627:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964488576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789478533.353659:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964488704:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789478533.353714:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478533.353814:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964488704 00000100:00100000:0.0:1789478533.353822:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964488704 00000100:00100000:0.0:1789478533.353868:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789478533.353877:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964488704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789478533.353895:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789478533.353939:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964488704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478533.353946:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789478533.353984:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964488704:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789478533.669282:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478534.694028:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789478534.891883:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1789478534.891899:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1789478534.892132:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000004:00080000:0.0:1789478534.893703:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000100:00100000:3.0:1789478534.893955:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964488832:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789478534.894022:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478534.894296:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964488832 00000100:00100000:2.0:1789478534.894315:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964488832 00000100:00100000:2.0:1789478534.894384:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789478534.894394:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964488832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789478534.894542:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789478534.894547:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1789478528 -> 1789478528 00002000:00010000:2.0:1789478534.894550:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 1789478528 -> 1789478528 00002000:00010000:2.0:1789478534.894552:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789478528 -> 1789478528 00002000:00010000:2.0:1789478534.894554:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789478534.894614:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1876403964488832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 222us (591us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789478534.894624:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1789478534.895102:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789478534.895134:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1789478534.895141:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ebb03f38a80, transno 4294967322 00000004:00080000:3.0:1789478534.895158:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1789478534.895182:0:3648:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ebb03f39880 x1876403964488832/t4294967325(4294967325) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789478550 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789478534.895192:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ebb03f39880/2, rc 0, transno 4294967325 00000100:00100000:3.0:1789478534.895198:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964488832:0@lo:2:osp-syn-1-0.0 00000001:00080000:0.0:1789478534.895542:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1789478534.895566:0:6496:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ebb010d6000 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789478534.895570:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ebb03e14900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ebb010d63c0 00000020:00080000:0.0:1789478534.895572:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ebb03e14500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ebb0227e200 00000020:00080000:0.0:1789478534.895591:0:6496:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:1.0:1789478534.895727:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216de1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478534.895740:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216de1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478534.895749:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216de1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478534.895764:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4ae00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478534.895769:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216de1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478534.895778:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216de1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478534.895795:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ebc1046f100) 00010000:00010000:1.0:1789478534.895809:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478534.895815:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216de1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478534.895821:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8216de1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789478534.896050:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1789478534.896105:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1789478535.722481:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478535.913324:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964488960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789478535.913392:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478535.913580:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964488960 00000100:00100000:2.0:1789478535.913588:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964488960 00000100:00100000:2.0:1789478535.913669:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789478535.913679:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964488960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789478535.913707:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789478535.913826:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964488960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478535.913833:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789478535.913869:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1789478535.913875:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1789478535.913892:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ebc3fca9880, transno 4294967311 00000100:00100000:2.0:1789478535.913910:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964488960:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789478535.913944:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789478536.050910:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478536.051076:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945579776 00000100:00100000:2.0:1789478536.051086:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945579776 00000100:00100000:2.0:1789478536.051160:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 255 00000100:00100000:2.0:1789478536.051170:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:12137:x1876403945579776:12345-192.168.206.11@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789478536.051297:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:12137:x1876403945579776:12345-192.168.206.11@tcp:60:lhsmtool_posix.0 Request processed in 128us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478536.051304:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 255 00000100:00080000:0.0:1789478536.052349:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789478536.054933:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478536.055048:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945579904 00000100:00100000:3.0:1789478536.055057:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945579904 00000100:00100000:3.0:1789478536.055230:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 256 00000100:00100000:3.0:1789478536.055245:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:12137:x1876403945579904:12345-192.168.206.11@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789478536.055433:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:12137:x1876403945579904:12345-192.168.206.11@tcp:60:lhsmtool_posix.0 Request processed in 193us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478536.055455:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 256 00000100:00080000:0.0:1789478536.055980:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789478536.057965:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478536.058105:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945580160 00000100:00100000:2.0:1789478536.058114:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945580160 00000100:00100000:2.0:1789478536.058169:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 65 00000100:00100000:2.0:1789478536.058252:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:12137:x1876403945580160:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789478536.058650:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+19:12137:x1876403945580160:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 401us (690us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789478536.058658:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 65 00000100:00100000:1.0:1789478536.217688:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478536.217837:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945580288 00000100:00100000:3.0:1789478536.217846:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945580288 00000100:00100000:3.0:1789478536.217972:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 257 00000100:00100000:3.0:1789478536.217982:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:12950:x1876403945580288:12345-192.168.206.11@tcp:101:lsof.0 00010000:00010000:3.0:1789478536.217999:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478536.218016:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e8216e6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b766d expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478536.218068:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216e74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478536.218080:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216e74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789478536.218177:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789478536.218270:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216e74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478536.218315:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789478536.218320:0:10096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789478536.218342:0:10096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216e74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478536.218364:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fdc00/0x8ebaae74e8216e6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b766d expref: 7 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478536.218382:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216e74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b766d expref: 6 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478536.218408:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc1046f900) 00010000:00010000:3.0:1789478536.218411:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789478536.218414:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fd800, rc 0) 00000100:00100000:3.0:1789478536.218561:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+6:12950:x1876403945580288:12345-192.168.206.11@tcp:101:lsof.0 Request processed in 580us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478536.218569:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 257 00000100:00100000:0.0:1789478536.320510:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478536.320551:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478536.320679:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945580544 00000100:00100000:3.0:1789478536.320689:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945580544 00000100:00100000:3.0:1789478536.320754:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 144 00000100:00100000:3.0:1789478536.320765:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945580544:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478536.320826:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945580544:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 64us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478536.320834:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 144 00000100:00080000:2.0:1789478536.320913:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789478536.321271:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478536.321296:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478536.321354:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945580672 00000100:00100000:2.0:1789478536.321358:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945580672 00000100:00100000:2.0:1789478536.321396:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 145 00000100:00100000:2.0:1789478536.321403:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2397:x1876403945580672:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1789478536.321435:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2397:x1876403945580672:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 33us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478536.321442:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 145 00000100:00100000:1.0:1789478536.323351:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945580800 00000100:00100000:1.0:1789478536.323364:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945580800 00000100:00100000:1.0:1789478536.323445:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 290 00000100:00100000:1.0:1789478536.323455:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2397:x1876403945580800:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478536.323527:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2397:x1876403945580800:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 74us (2975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478536.323534:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 290 00000100:00080000:0.0:1789478536.323694:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789478536.323698:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789478536.325316:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945580416 00000100:00100000:3.0:1789478536.325328:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945580416 00000100:00100000:3.0:1789478536.325421:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 381 00000100:00100000:3.0:1789478536.325431:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2397:x1876403945580416:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478536.325486:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2397:x1876403945580416:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 57us (4216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478536.325493:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 381 00000100:00100000:0.0:1789478536.422934:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964489088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789478536.423014:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478536.423299:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964489088 00000100:00100000:2.0:1789478536.423308:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964489088 00000100:00100000:2.0:1789478536.423380:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789478536.423390:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964489088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789478536.423411:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789478536.423466:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964489088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478536.423486:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789478536.423573:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964489088:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789478536.423807:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1789478536.549901:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789478536.740819:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789478536.740828:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789478536.740848:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789478536.740856:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789478536.740992:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478537.768621:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478537.956833:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964489344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789478537.956906:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478537.956991:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964489216:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789478537.957019:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478537.957112:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789478537.957131:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964489728:0@lo:400:kworker.0 00000100:00100000:3.0:1789478537.957154:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478537.957193:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964489344 00000100:00100000:3.0:1789478537.957200:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964489344 00000100:00100000:3.0:1789478537.957246:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964489216 00000100:00100000:3.0:1789478537.957249:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964489216 00000100:00100000:3.0:1789478537.957262:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964489728 00000100:00100000:3.0:1789478537.957265:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964489728 00000100:00100000:3.0:1789478537.957277:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789478537.957285:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964489344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789478537.957317:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789478537.958100:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964489472:0@lo:400:kworker.0 00000100:00100000:1.0:1789478537.958173:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478537.958249:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964489344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 962us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478537.958261:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789478537.958284:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789478537.958293:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1876403964489216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789478537.958313:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789478537.958352:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1876403964489216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478537.958359:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964489984:0@lo:400:kworker.0 00000100:00100000:3.0:1789478537.958360:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789478537.958379:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789478537.958387:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964489728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478537.958393:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478537.958416:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789478537.958422:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964489600:0@lo:400:kworker.0 00000100:00100000:3.0:1789478537.958440:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964489728:12345-0@lo:400:kworker.0 Request processed in 52us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478537.958451:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789478537.958452:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478537.958477:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964490112:0@lo:400:kworker.0 00000100:00100000:3.0:1789478537.958492:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964489984 00000100:00100000:3.0:1789478537.958498:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964489984 00000100:00100000:1.0:1789478537.958500:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478537.958531:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964489472 00000100:00100000:1.0:1789478537.958536:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964489472 00000100:00100000:3.0:1789478537.958551:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964489600 00000100:00100000:3.0:1789478537.958557:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964489600 00000100:00100000:1.0:1789478537.958569:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1789478537.958578:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc272ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3645:x1876403964489472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478537.958581:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964490112 00000100:00100000:3.0:1789478537.958586:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964490112 00000100:00100000:1.0:1789478537.958629:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc272ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3645:x1876403964489472:12345-0@lo:400:kworker.0 Request processed in 53us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478537.958636:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1789478537.958641:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789478537.958650:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964489984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478537.958668:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1789478537.958677:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964489600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478537.958700:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964489984:12345-0@lo:400:kworker.0 Request processed in 51us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478537.958709:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789478537.958714:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964489600:12345-0@lo:400:kworker.0 Request processed in 38us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478537.958722:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789478537.958728:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1789478537.958739:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964490112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478537.958772:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964489600:0@lo:400:kworker.0 00000100:00100000:3.0:1789478537.958778:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964490112:12345-0@lo:400:kworker.0 Request processed in 41us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478537.958786:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00010000:00080000:1.0:1789478537.958790:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03ffed80 x1876403964490112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478537.958802:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964490112:0@lo:400:kworker.0 00000100:00100000:1.0:1789478537.958813:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964489984:0@lo:400:kworker.0 00000100:00100000:1.0:1789478537.958833:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:3645:1876403964489472:0@lo:400:kworker.0 00000100:00100000:3.0:1789478537.958837:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876403964489856:0@lo:400:kworker.0 00000100:00100000:3.0:1789478537.958867:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789478537.958870:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789478537.958875:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789478537.958888:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964489856 00000100:00100000:3.0:1789478537.958890:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964490368:0@lo:400:kworker.0 00000100:00100000:1.0:1789478537.958893:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964489856 00000100:00100000:1.0:1789478537.958924:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789478537.958928:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478537.958936:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876403964489856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478537.958958:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964489728:0@lo:400:kworker.0 00000100:00100000:1.0:1789478537.958975:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876403964489856:12345-0@lo:400:kworker.0 Request processed in 41us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478537.958979:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964489216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478537.958986:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789478537.959011:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876403964489856:0@lo:400:kworker.0 00000100:00100000:3.0:1789478537.959020:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789478537.959033:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964490368 00000100:00100000:1.0:1789478537.959037:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964490368 00000100:00100000:1.0:1789478537.959067:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789478537.959073:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964490368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478537.959102:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964490368:12345-0@lo:400:kworker.0 Request processed in 29us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478537.959108:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964490240:0@lo:400:kworker.0 00000100:00100000:1.0:1789478537.959111:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:1.0:1789478537.959134:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789478537.959142:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478537.959169:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964490368:0@lo:400:kworker.0 00000100:00100000:1.0:1789478537.959176:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964490240 00000100:00100000:1.0:1789478537.959182:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964490240 00000100:00100000:1.0:1789478537.959218:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789478537.959226:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964490240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478537.959291:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964489344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789478537.959417:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb044b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964490496:0@lo:400:kworker.0 00000100:00100000:1.0:1789478537.959427:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964490240:12345-0@lo:400:kworker.0 Request processed in 200us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478537.959435:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789478537.959451:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478537.959462:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb044b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876403964490624:0@lo:400:kworker.0 00000100:00100000:2.0:1789478537.959487:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964490496 00000100:00100000:2.0:1789478537.959492:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964490496 00000100:00100000:1.0:1789478537.959499:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478537.959529:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964490624 00000100:00100000:2.0:1789478537.959534:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964490624 00000100:00080000:1.0:1789478537.959543:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789478537.959548:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789478537.959560:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789478537.959567:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964490496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478537.959571:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789478537.959582:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876403964490624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478537.959637:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964490496:12345-0@lo:400:kworker.0 Request processed in 68us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478537.959647:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876403964490624:12345-0@lo:400:kworker.0 Request processed in 65us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478537.959648:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789478537.959658:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789478537.959689:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb044b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964490496:0@lo:400:kworker.0 00010000:00080000:1.0:1789478537.959695:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb044b7800 x1876403964490624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478537.959706:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb044b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876403964490624:0@lo:400:kworker.0 00000100:00100000:2.0:1789478537.959711:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb044b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964490752:0@lo:400:kworker.0 00000100:00100000:2.0:1789478537.959739:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478537.959867:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964490752 00000100:00100000:1.0:1789478537.959871:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964490752 00000100:00100000:1.0:1789478537.959911:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789478537.959917:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964490752:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789478537.959925:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789478537.959951:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964490752:12345-0@lo:400:kworker.0 Request processed in 34us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478537.959957:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789478537.959958:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb044b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964490752:0@lo:400:kworker.0 00000100:00100000:2.0:1789478537.960139:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789478537.960147:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb044b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964490880:0@lo:400:kworker.0 00000100:00100000:2.0:1789478537.960170:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478537.960216:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964490880 00000100:00100000:1.0:1789478537.960221:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964490880 00000100:00100000:3.0:1789478537.960230:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964490240:0@lo:400:kworker.0 00000100:00100000:1.0:1789478537.960267:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00080000:2.0:1789478537.960269:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789478537.960277:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876403964490880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478537.960314:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876403964490880:12345-0@lo:400:kworker.0 Request processed in 40us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478537.960320:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789478537.960335:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb044b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964490880:0@lo:400:kworker.0 00000100:00100000:1.0:1789478538.474347:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964491136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789478538.474417:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478538.474464:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789478538.474471:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964491008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789478538.474495:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478538.474525:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964491136 00000100:00100000:1.0:1789478538.474533:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964491136 00000100:00100000:1.0:1789478538.474571:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964491008 00000100:00100000:1.0:1789478538.474574:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964491008 00000100:00100000:1.0:1789478538.474589:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789478538.474621:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876403964491136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789478538.474647:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789478538.474687:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876403964491136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478538.474694:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789478538.474710:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789478538.474716:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964491008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789478538.474726:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789478538.474748:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964491008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478538.474753:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789478538.474792:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964491008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789478538.474806:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964491136:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789478538.796311:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789478538.843983:0:15052:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 09:22:17 (1789478537) 00010000:00010000:3.0:1789478539.813116:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478540.839400:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478541.031139:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb044b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964491264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789478541.031220:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478541.031938:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964491264 00000100:00100000:0.0:1789478541.031948:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964491264 00000100:00100000:0.0:1789478541.032005:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789478541.032014:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964491264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789478541.032040:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789478541.032090:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964491264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478541.032103:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789478541.032149:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb044b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964491264:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789478541.032336:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789478541.034090:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1789478541.034104:0:6496:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1789478541.034146:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1789478541.034156:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:1.0:1789478541.034521:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000100:00100000:0.0:1789478541.391439:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478541.391527:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945581056 00000100:00100000:1.0:1789478541.391546:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945581056 00000100:00100000:1.0:1789478541.391653:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 66 00000100:00100000:1.0:1789478541.391665:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+18:13173:x1876403945581056:12345-192.168.206.11@tcp:35:umount.0 00000100:00080000:2.0:1789478541.391887:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789478541.392232:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+19:13173:x1876403945581056:12345-192.168.206.11@tcp:35:umount.0 Request processed in 567us (799us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1789478541.392241:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 66 00000100:00100000:1.0:1789478541.395587:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478541.395694:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945581312 00000100:00100000:3.0:1789478541.395702:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945581312 00000100:00100000:3.0:1789478541.395751:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 67 00000100:00100000:3.0:1789478541.395760:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+19:13173:x1876403945581312:12345-192.168.206.11@tcp:35:umount.0 00000100:00100000:3.0:1789478541.398433:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+20:13173:x1876403945581312:12345-192.168.206.11@tcp:35:umount.0 Request processed in 2662us (2843us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789478541.398447:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 67 00000100:00100000:0.0:1789478541.407643:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478541.407740:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945581568 00000100:00100000:1.0:1789478541.407749:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945581568 00000100:00100000:1.0:1789478541.407805:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 68 00000100:00100000:1.0:1789478541.407815:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc0838d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+20:13173:x1876403945581568:12345-192.168.206.11@tcp:35:umount.0 00000100:00100000:1.0:1789478541.408024:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc0838d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+21:13173:x1876403945581568:12345-192.168.206.11@tcp:35:umount.0 Request processed in 209us (388us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1789478541.408032:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 68 00000100:00100000:0.0:1789478541.410395:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478541.410535:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945581824 00000100:00100000:3.0:1789478541.410544:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945581824 00000100:00100000:1.0:1789478541.410717:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 69 00000100:00100000:1.0:1789478541.410729:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+21:13173:x1876403945581824:12345-192.168.206.11@tcp:35:umount.0 00000100:00100000:1.0:1789478541.411112:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+22:13173:x1876403945581824:12345-192.168.206.11@tcp:35:umount.0 Request processed in 385us (724us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1789478541.411120:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 69 00000100:00100000:2.0:1789478541.431087:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478541.431134:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478541.431269:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478541.432868:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478541.432898:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945582592 00000100:00100000:2.0:1789478541.432906:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945582592 00000100:00100000:2.0:1789478541.432960:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 80 00000100:00100000:2.0:1789478541.432970:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+7:2394:x1876403945582592:12345-192.168.206.11@tcp:9:umount.0 00000020:00000080:2.0:1789478541.432995:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e82163df 00000020:00010000:2.0:1789478541.433003:0:8431:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ebc056d8000: total 0 00000100:00080000:2.0:1789478541.433007:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8ebc056db800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789478541.433047:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1789478541.433218:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2394:x1876403945582592:12345-192.168.206.11@tcp:9:umount.0 Request processed in 249us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478541.433226:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 80 00000100:00080000:2.0:1789478541.433245:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:2.0:1789478541.433266:0:6505:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ebc056d8000: total 0 00010000:00010000:2.0:1789478541.433300:0:6505:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ebc056d8000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1789478541.433350:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d96df3c7/0x8ebaae74e8216e66 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7666 expref: 4 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478541.433406:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008695a243/0x8ebaae74e8216797 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7483 expref: 3 pid: 8829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478541.433431:0:6505:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ebc056d8000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1789478541.433445:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478541.433448:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478541.433449:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478541.433629:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945581952 00000100:00100000:1.0:1789478541.433635:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945581952 00000100:00100000:1.0:1789478541.433676:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945582208 00000100:00100000:1.0:1789478541.433680:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945582208 00000100:00100000:1.0:1789478541.433698:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945582080 00000100:00100000:1.0:1789478541.433701:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945582080 00000100:00100000:1.0:1789478541.433719:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:1.0:1789478541.433734:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+15:2398:x1876403945581952:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789478541.433745:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478541.433757:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc34f76200/0x8ebaae74e8215dcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b71c0 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478541.433769:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478541.433794:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+14:2398:x1876403945581952:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 62us (2716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478541.433801:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:1.0:1789478541.433817:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:1.0:1789478541.433824:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+13:2395:x1876403945582208:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789478541.433831:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478541.433840:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc40fcf400/0x8ebaae74e821605f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7299 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478541.433849:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478541.433867:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+12:2395:x1876403945582208:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 43us (2732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478541.433873:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:1.0:1789478541.433886:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 22 00000100:00100000:1.0:1789478541.433892:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+11:2398:x1876403945582080:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789478541.433900:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478541.433909:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc34f77400/0x8ebaae74e8215d8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7181 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478541.434205:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478541.434501:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:2398:x1876403945582080:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 606us (3230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478541.434509:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 22 00000100:00100000:2.0:1789478541.437939:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478541.437977:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478541.437994:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945582848 00000100:00100000:1.0:1789478541.438003:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945582848 00000100:00100000:2.0:1789478541.438006:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478541.438031:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00080000:0.0:1789478541.438044:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789478541.438055:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945583104 00000100:00100000:1.0:1789478541.438057:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 150 00000100:00100000:2.0:1789478541.438059:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945583104 00000100:00100000:1.0:1789478541.438067:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945582848:12345-192.168.206.11@tcp:400:kworker.0 00000100:00080000:0.0:1789478541.438094:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789478541.438097:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945582720 00000100:00100000:2.0:1789478541.438100:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945582720 00000100:00100000:2.0:1789478541.438119:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945582976 00000100:00100000:2.0:1789478541.438122:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945582976 00000100:00100000:1.0:1789478541.438131:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945582848:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 65us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478541.438137:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 297 00000100:00100000:1.0:1789478541.438142:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 150 00000100:00100000:0.0:1789478541.438196:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2397:x1876403945583104:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478541.438233:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2397:x1876403945583104:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 86us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478541.438240:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 298 00000100:00100000:2.0:1789478541.438249:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945582720:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1789478541.438282:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2397:x1876403945582720:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 34us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478541.438285:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 299 00000100:00100000:3.0:1789478541.438299:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+6:2397:x1876403945582976:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478541.438331:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+6:2397:x1876403945582976:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 36us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478541.438338:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 299 00000100:00100000:2.0:1789478541.438431:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 298 00000100:00100000:2.0:1789478541.438804:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478541.438946:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945583232 00000100:00100000:3.0:1789478541.438951:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945583232 00000100:00100000:3.0:1789478541.438989:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 81 00000100:00100000:3.0:1789478541.438997:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2394:x1876403945583232:12345-192.168.206.11@tcp:9:umount.0 00000020:00000080:3.0:1789478541.439016:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8216169 00000100:00080000:3.0:1789478541.439035:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8ebb03d71000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1789478541.439079:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00000004:3.0:1789478541.439082:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1789478541.439240:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+2:2394:x1876403945583232:12345-192.168.206.11@tcp:9:umount.0 Request processed in 243us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478541.439249:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 81 00010000:00010000:3.0:1789478541.439268:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478541.441131:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 297 00000100:00100000:2.0:1789478541.456740:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478541.457375:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945584256 00000100:00100000:3.0:1789478541.457385:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945584256 00000100:00100000:3.0:1789478541.457451:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 258 00000100:00100000:3.0:1789478541.457461:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+22:2394:x1876403945584256:12345-192.168.206.11@tcp:39:umount.0 00000020:00000080:3.0:1789478541.457491:0:6519:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215d9c 00000020:00010000:3.0:1789478541.457505:0:6519:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ebb034e4800: total 0 00000100:00080000:3.0:1789478541.457509:0:6519:0:(import.c:65:import_set_state_nolock()) ffff8ebb034e2800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789478541.457537:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:3.0:1789478541.457731:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+21:2394:x1876403945584256:12345-192.168.206.11@tcp:39:umount.0 Request processed in 270us (998us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1789478541.457739:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 258 00000020:00010000:1.0:1789478541.458533:0:8447:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ebb034e4800: total 0 00010000:00010000:1.0:1789478541.458584:0:8447:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ebb034e4800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789478541.458645:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:1.0:1789478541.458650:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789478541.458658:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e8216782 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b747c expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478541.458676:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:1.0:1789478541.458679:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789478541.458683:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc000/0x8ebaae74e821643a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b739c expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478541.458711:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ebc40e36e00) 00010000:00010000:1.0:1789478541.458713:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478541.458717:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66600/0x8ebaae74e82160e4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72ae expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478541.458751:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:1.0:1789478541.458754:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789478541.458758:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc42176000/0x8ebaae74e8216d47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7619 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478541.458938:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:1.0:1789478541.458941:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789478541.458946:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc400/0x8ebaae74e821681c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b74a6 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478541.458958:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:1.0:1789478541.458960:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789478541.458963:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4be00/0x8ebaae74e8216678 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7436 expref: 15 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478541.458974:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ebc21ed2600) 00010000:00010000:1.0:1789478541.458976:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789478541.458979:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e82160c8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72a7 expref: 14 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478541.458992:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:1.0:1789478541.458994:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789478541.458997:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fca00/0x8ebaae74e8216e27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7651 expref: 13 pid: 13638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478541.459007:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ebb024f4500) 00010000:00010000:1.0:1789478541.459009:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789478541.459019:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029df000/0x8ebaae74e8216e51 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b765f expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478541.459033:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ebb02503600) 00010000:00010000:1.0:1789478541.459035:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789478541.459039:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fc200/0x8ebaae74e821613f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b72c3 expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478541.459051:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ebb02275400) 00010000:00010000:1.0:1789478541.459053:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789478541.459057:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc029dfc00/0x8ebaae74e8216b09 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b757f expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478541.459069:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc1046f900) 00010000:00010000:1.0:1789478541.459071:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789478541.459075:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc34f76600/0x8ebaae74e8216800 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b749f expref: 9 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478541.459086:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ebc40e80700) 00010000:00010000:1.0:1789478541.459089:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789478541.459092:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc421eca00/0x8ebaae74e8216758 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b746e expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478541.459104:0:8447:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ebb034e4800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1789478541.459120:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478541.459122:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478541.459124:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478541.477958:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478541.478060:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945584384 00000100:00100000:2.0:1789478541.478069:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945584384 00000100:00100000:2.0:1789478541.478148:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 259 00000100:00100000:2.0:1789478541.478159:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+5:2394:x1876403945584384:12345-192.168.206.11@tcp:39:umount.0 00000020:00000080:2.0:1789478541.478200:0:10096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215da3 00000100:00080000:2.0:1789478541.478215:0:10096:0:(import.c:65:import_set_state_nolock()) ffff8ebb034e2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789478541.478243:0:10096:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789478541.478390:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:327dd6d5-45fd-4b52-99bf-74d27d1ede6e+3:2394:x1876403945584384:12345-192.168.206.11@tcp:39:umount.0 Request processed in 232us (438us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789478541.478397:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 259 00010000:00010000:0.0:1789478541.481883:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478541.546735:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964491392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789478541.546802:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478541.547051:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964491392 00000100:00100000:2.0:1789478541.547059:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964491392 00000100:00100000:2.0:1789478541.547141:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789478541.547151:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964491392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789478541.547171:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789478541.547245:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964491392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478541.547252:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789478541.547294:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964491392:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789478541.547613:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789478541.861530:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478542.885948:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478542.963443:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478542.963486:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478542.963524:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478542.963631:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945584512 00000100:00100000:2.0:1789478542.963641:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945584512 00000100:00100000:2.0:1789478542.963696:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945584768 00000100:00100000:2.0:1789478542.963700:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945584768 00000100:00100000:2.0:1789478542.963719:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945584640 00000100:00100000:2.0:1789478542.963722:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945584640 00000100:00100000:2.0:1789478542.963739:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 23 00000100:00100000:2.0:1789478542.963748:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+12:2398:x1876403945584512:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789478542.963761:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478542.963779:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc35b66800/0x8ebaae74e8215e9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b71d5 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478542.963808:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478542.963854:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+11:2398:x1876403945584512:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 106us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478542.963862:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 23 00000100:00100000:2.0:1789478542.963880:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:2.0:1789478542.963886:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08342050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+10:2398:x1876403945584768:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789478542.963893:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478542.963902:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc40fce200/0x8ebaae74e8216058 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7292 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478542.963912:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478542.963930:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08342050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+9:2398:x1876403945584768:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 44us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478542.963936:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:2.0:1789478542.963987:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:2.0:1789478542.963995:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+8:2398:x1876403945584640:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789478542.964003:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478542.964012:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebb035fd200/0x8ebaae74e8215ea6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7206 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478542.964020:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478542.964469:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+7:2398:x1876403945584640:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 473us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478542.964476:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:1.0:1789478542.965374:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478542.965506:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945585024 00000100:00100000:2.0:1789478542.965522:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945585024 00000100:00100000:2.0:1789478542.965570:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 260 00000100:00100000:2.0:1789478542.965579:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+6:2394:x1876403945585024:12345-192.168.206.11@tcp:39:umount.0 00000020:00000080:2.0:1789478542.965637:0:6518:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215eb4 00000020:00010000:2.0:1789478542.965645:0:6518:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ebc40fbb000: total 0 00000100:00080000:2.0:1789478542.965650:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8ebc40fbd800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789478542.965678:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:0.0:1789478542.965868:0:6505:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ebc40fbb000: total 0 00010000:00010000:0.0:1789478542.965872:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478542.965920:0:6505:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ebc40fbb000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789478542.965954:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc1046f900) 00010000:00010000:0.0:1789478542.965958:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789478542.965965:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebb035fd800/0x8ebaae74e8216e74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b766d expref: 6 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478542.966142:0:6505:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ebc40fbb000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789478542.966153:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478542.966159:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478542.966160:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478542.966463:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+3:2394:x1876403945585024:12345-192.168.206.11@tcp:39:umount.0 Request processed in 883us (1090us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1789478542.966472:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 260 00000100:00100000:1.0:1789478542.971478:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478542.971635:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945585152 00000100:00100000:2.0:1789478542.971644:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945585152 00000100:00100000:2.0:1789478542.971707:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 261 00000100:00100000:2.0:1789478542.971718:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+5:2394:x1876403945585152:12345-192.168.206.11@tcp:39:umount.0 00000020:00000080:2.0:1789478542.971757:0:13638:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215ebb 00000100:00080000:2.0:1789478542.971766:0:13638:0:(import.c:65:import_set_state_nolock()) ffff8ebc40fba800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789478542.971793:0:13638:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1789478542.972044:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478542.973705:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a1d5e8d-e61d-452f-a651-9ee87fa9267a+3:2394:x1876403945585152:12345-192.168.206.11@tcp:39:umount.0 Request processed in 1981us (2227us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789478542.973716:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 261 00000100:00100000:1.0:1789478543.019053:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478543.019142:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945585408 00000100:00100000:2.0:1789478543.019151:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945585408 00000100:00100000:2.0:1789478543.019213:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 383 00000100:00100000:2.0:1789478543.019223:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc272aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+7:2394:x1876403945585408:12345-192.168.206.11@tcp:251:umount.0 00000020:00000080:2.0:1789478543.019263:0:6510:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215d79 00000020:00010000:2.0:1789478543.019271:0:6510:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ebb034e6800: total 0 00000100:00080000:2.0:1789478543.019276:0:6510:0:(import.c:65:import_set_state_nolock()) ffff8ebb034e0800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1789478543.019362:0:8447:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ebb034e6800: total 0 00000100:00100000:2.0:1789478543.019363:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc272aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39e0b8b0-9342-4e5e-adb0-5ee35a65200e+3:2394:x1876403945585408:12345-192.168.206.11@tcp:251:umount.0 Request processed in 139us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478543.019375:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 383 00010000:00010000:0.0:1789478543.019420:0:8447:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ebb034e6800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789478543.019460:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc34f77200/0x8ebaae74e8215dd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b71c7 expref: 2 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478543.019474:0:8447:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ebb034e6800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789478543.019487:0:8447:0:(genops.c:885:class_export_put()) final put ffff8ebb034e6800/39e0b8b0-9342-4e5e-adb0-5ee35a65200e 00010000:00010000:0.0:1789478543.019508:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478543.019510:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478543.019512:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789478543.022233:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebb034e6800/39e0b8b0-9342-4e5e-adb0-5ee35a65200e for MGS 00000020:00000080:2.0:1789478543.022298:0:14273:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebb034e0800 for MGS 00000100:00100000:2.0:1789478543.077221:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964491520:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789478543.077365:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478543.077810:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964491520 00000100:00100000:0.0:1789478543.077818:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964491520 00000100:00100000:0.0:1789478543.077864:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789478543.077873:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964491520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789478543.077904:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789478543.078588:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964492032:0@lo:400:kworker.0 00000100:00100000:2.0:1789478543.078638:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478543.078717:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964491648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478543.078747:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478543.078791:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964492032 00000100:00100000:1.0:1789478543.078796:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964492032 00000100:00100000:1.0:1789478543.078820:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964491648 00000100:00100000:1.0:1789478543.078822:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964491648 00000100:00100000:1.0:1789478543.078835:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789478543.078842:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1876403964492032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478543.078880:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1876403964492032:12345-0@lo:400:kworker.0 Request processed in 38us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478543.078888:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789478543.078904:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789478543.078910:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964491648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789478543.078929:0:7991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789478543.078964:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964491648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478543.078970:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789478543.079122:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964491648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478543.079216:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964491776:0@lo:400:kworker.0 00000100:00100000:1.0:1789478543.079247:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478543.079286:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789478543.079293:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964491904:0@lo:400:kworker.0 00000100:00100000:1.0:1789478543.079334:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478543.079476:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964491776 00000100:00100000:1.0:1789478543.079481:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964491776 00000100:00100000:1.0:1789478543.079508:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1789478543.079516:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964491776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478543.079550:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3647:x1876403964491776:12345-0@lo:400:kworker.0 Request processed in 36us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478543.079556:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1789478543.079582:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964491904 00000100:00100000:1.0:1789478543.079586:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964491904 00000100:00100000:1.0:1789478543.079630:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789478543.079636:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964491904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478543.079666:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964491904:12345-0@lo:400:kworker.0 Request processed in 30us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478543.079673:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789478543.079702:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964491904:0@lo:400:kworker.0 00000100:00100000:1.0:1789478543.079710:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964491776:0@lo:400:kworker.0 00000100:00100000:0.0:1789478543.079875:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964491520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2001us (2508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478543.079882:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789478543.083785:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876403964492416:0@lo:400:kworker.0 00000100:00100000:3.0:1789478543.083846:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478543.083879:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876403964492928:0@lo:400:kworker.0 00000100:00100000:3.0:1789478543.083897:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478543.083920:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789478543.083925:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876403964492288:0@lo:400:kworker.0 00000100:00100000:3.0:1789478543.083975:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478543.083998:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876403964492800:0@lo:400:kworker.0 00000100:00100000:3.0:1789478543.084017:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478543.084054:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964492416 00000100:00100000:3.0:1789478543.084061:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964492416 00000100:00100000:1.0:1789478543.084198:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876403964492160:0@lo:400:kworker.0 00000100:00100000:1.0:1789478543.084229:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478543.084249:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964492672:0@lo:400:kworker.0 00000100:00100000:1.0:1789478543.084288:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478543.084293:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964492928 00000100:00100000:3.0:1789478543.084299:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964492928 00000100:00100000:1.0:1789478543.084308:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964493184:0@lo:400:kworker.0 00000100:00100000:3.0:1789478543.084318:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964492288 00000100:00100000:3.0:1789478543.084322:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964492288 00000100:00100000:1.0:1789478543.084335:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478543.084339:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964492800 00000100:00100000:3.0:1789478543.084343:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964492800 00000100:00100000:3.0:1789478543.084355:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964492160 00000100:00100000:3.0:1789478543.084357:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964492160 00000100:00100000:3.0:1789478543.084370:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789478543.084378:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0359b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876403964492416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478543.084505:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0359b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876403964492416:12345-0@lo:400:kworker.0 Request processed in 126us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478543.084508:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789478543.084517:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964492544:0@lo:400:kworker.0 00000100:00100000:1.0:1789478543.084552:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478543.084572:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964493056:0@lo:400:kworker.0 00000100:00100000:3.0:1789478543.084582:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1789478543.084629:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478543.084630:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1789478543.084641:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0359b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876403964492928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478543.084663:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964492672 00000100:00100000:1.0:1789478543.084668:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964492672 00000100:00100000:3.0:1789478543.084679:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0359b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876403964492928:12345-0@lo:400:kworker.0 Request processed in 40us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478543.084687:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789478543.084697:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964493184 00000100:00100000:1.0:1789478543.084701:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964493184 00000100:00100000:3.0:1789478543.084707:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789478543.084717:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0359ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876403964492288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478543.084720:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964492544 00000100:00100000:1.0:1789478543.084725:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964492544 00000100:00100000:1.0:1789478543.084747:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964493056 00000100:00100000:1.0:1789478543.084750:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964493056 00000100:00100000:3.0:1789478543.084753:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0359ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876403964492288:12345-0@lo:400:kworker.0 Request processed in 38us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478543.084770:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789478543.084784:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789478543.084791:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0359aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876403964492800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478543.084820:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0359aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876403964492800:12345-0@lo:400:kworker.0 Request processed in 30us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478543.084825:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789478543.084836:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789478543.084841:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876403964492160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478543.084876:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876403964492160:12345-0@lo:400:kworker.0 Request processed in 34us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478543.084882:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1789478543.084887:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789478543.084896:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964492672:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789478543.084901:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789478543.084907:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789478543.084909:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789478543.084912:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789478543.084938:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964492672:12345-0@lo:400:kworker.0 Request processed in 43us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478543.084948:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789478543.084963:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789478543.084969:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964493184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478543.085016:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964493184:12345-0@lo:400:kworker.0 Request processed in 47us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478543.085022:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789478543.085042:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789478543.085049:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964492544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478543.085059:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876403964492160:0@lo:400:kworker.0 00000100:00100000:1.0:1789478543.085085:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964492544:12345-0@lo:400:kworker.0 Request processed in 35us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478543.085096:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964492672:0@lo:400:kworker.0 00000100:00100000:3.0:1789478543.085110:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1789478543.085114:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ebb03f39880, transno 4294967325 00000100:00100000:3.0:1789478543.085126:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964493184:0@lo:400:kworker.0 00000100:00100000:3.0:1789478543.085149:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964492544:0@lo:400:kworker.0 00000100:00100000:3.0:1789478543.085279:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876403964492288:0@lo:400:kworker.0 00000100:00100000:3.0:1789478543.085289:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876403964492800:0@lo:400:kworker.0 00010000:00080000:3.0:1789478543.085312:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb04487b80 x1876403964492416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478543.085322:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876403964492416:0@lo:400:kworker.0 00010000:00080000:3.0:1789478543.085332:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03599500 x1876403964492928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478543.085339:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876403964492928:0@lo:400:kworker.0 00000100:00100000:2.0:1789478543.086270:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964491520:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789478543.086334:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964492032:0@lo:400:kworker.0 00000100:00100000:0.0:1789478543.086718:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789478543.086734:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964493056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478543.086801:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964493056:12345-0@lo:400:kworker.0 Request processed in 74us (2175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478543.086852:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789478543.086894:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964493056:0@lo:400:kworker.0 00000100:00100000:1.0:1789478543.087453:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789478543.589754:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964493312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789478543.589843:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478543.590103:0:11355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964493312 00000100:00100000:1.0:1789478543.590116:0:11355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964493312 00000100:00100000:1.0:1789478543.590170:0:11355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789478543.590191:0:11355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964493312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789478543.590217:0:11355:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789478543.590276:0:11355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964493312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478543.590282:0:11355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789478543.590405:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964493312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789478543.591363:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964493440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789478543.591407:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478543.591672:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964493440 00000100:00100000:1.0:1789478543.591680:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964493440 00000100:00100000:1.0:1789478543.591817:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789478543.591896:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964493440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789478543.591917:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789478543.592012:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964493440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478543.592019:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789478543.595252:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964493440:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789478543.908875:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789478544.408331:0:15248:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1789478544.423297:0:15248:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1789478544.423349:0:15248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66400/0x8ebaae74e8215e2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e36 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478544.423364:0:15248:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66400/0x8ebaae74e8215e2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215e36 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478544.423371:0:15248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66400/0x8ebaae74e8215e2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8215e36 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478544.423377:0:15248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66400/0x8ebaae74e8215e2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8215e36 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478544.423443:0:15248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789478544.423460:0:15248:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789478544.423484:0:15248:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789478544.423489:0:15248:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789478544.423494:0:15248:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789478544.423515:0:15248:0:(import.c:65:import_set_state_nolock()) ffff8ebc0837f000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789478544.423656:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876403964493568:0@lo:39:umount.0 00000100:00100000:0.0:1789478544.423727:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478544.423766:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964493568 00000100:00100000:1.0:1789478544.423773:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964493568 00000100:00100000:1.0:1789478544.423819:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789478544.423828:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876403964493568:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789478544.423850:0:6517:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215990 00000100:00080000:1.0:1789478544.423856:0:6517:0:(import.c:65:import_set_state_nolock()) ffff8ebc0837d800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789478544.423924:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789478544.423931:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66400/0x8ebaae74e8215e2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8215e36 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478544.423934:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3644:x1876403964493568:12345-0@lo:39:umount.0 Request processed in 106us (206us total) trans 0 rc 0/0 00010000:00010000:0.0:1789478544.423947:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b66400 already unused, calling callback (ffffffffc1383c20) 00000100:00100000:1.0:1789478544.423948:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 10000000:00010000:0.0:1789478544.423954:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66400/0x8ebaae74e8215e2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8215e36 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789478544.423959:0:6517:0:(genops.c:885:class_export_put()) final put ffff8ebc0837a800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1789478544.423967:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66400/0x8ebaae74e8215e2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ebaae74e8215e36 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478544.423976:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66400/0x8ebaae74e8215e2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ebaae74e8215e36 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478544.423981:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789478544.423984:0:8447:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789478544.423986:0:8447:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789478544.424009:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66400/0x8ebaae74e8215e2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e8215e36 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478544.424016:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478544.424052:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66400/0x8ebaae74e8215e2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e8215e36 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478544.424067:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66400/0x8ebaae74e8215e2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e8215e36 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478544.424079:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478544.424081:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478544.424082:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789478544.424109:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc0837a800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:0.0:1789478544.424110:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc0837f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789478544.424122:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876403964493568:0@lo:39:umount.0 00000100:00100000:0.0:1789478544.424146:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:00000080:2.0:1789478544.424152:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc0837d800 for lustre-MDT0000 00000100:00100000:0.0:1789478544.424157:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb044b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964493696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789478544.424200:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478544.424261:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964493696 00000100:00100000:2.0:1789478544.424265:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964493696 00000100:00100000:2.0:1789478544.424305:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789478544.424313:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3646:x1876403964493696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789478544.424323:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478544.424335:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc40fcee00/0x8ebaae74e8215e36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ebaae74e8215e2f expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478544.424347:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478544.424381:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c56e5039-4535-4d8a-bd01-962355b55f9c+23:3646:x1876403964493696:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478544.424389:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1789478544.424397:0:15248:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789478544.424401:0:15248:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789478544.424406:0:15248:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1789478544.424523:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb044b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964493696:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789478544.424863:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478544.427225:0:15248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8215e3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e44 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478544.427242:0:15248:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8215e3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215e44 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478544.427250:0:15248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8215e3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8215e44 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478544.427256:0:15248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8215e3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8215e44 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478544.427300:0:15248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789478544.427324:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789478544.427331:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8215e3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8215e44 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478544.427339:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77a00 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478544.427343:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8215e3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8215e44 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478544.427351:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8215e3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ebaae74e8215e44 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478544.427359:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8215e3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ebaae74e8215e44 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478544.427365:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789478544.427374:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1789478544.427403:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8215e3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e8215e44 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478544.427409:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478544.427443:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8215e3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e8215e44 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478544.427450:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8215e3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e8215e44 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478544.427462:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478544.427464:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478544.427466:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478544.427487:0:15248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed000/0x8ebaae74e8215d33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215d3a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478544.427497:0:15248:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed000/0x8ebaae74e8215d33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215d3a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478544.427505:0:15248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed000/0x8ebaae74e8215d33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8215d3a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478544.427513:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb044b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964493824:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789478544.427513:0:15248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed000/0x8ebaae74e8215d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8215d3a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478544.427542:0:15248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789478544.427550:0:15248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8216097 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e821609e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478544.427557:0:15248:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8216097 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e821609e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478544.427565:0:15248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8216097 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e821609e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478544.427571:0:15248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8216097 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e821609e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478544.427583:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789478544.427585:0:15248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789478544.427616:0:15248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec600/0x8ebaae74e82158ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82158f6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478544.427631:0:15248:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec600/0x8ebaae74e82158ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e82158f6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478544.427638:0:15248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec600/0x8ebaae74e82158ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e82158f6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478544.427644:0:15248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec600/0x8ebaae74e82158ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e82158f6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478544.427657:0:15248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1789478544.427660:0:15248:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1789478544.427665:0:15248:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1789478544.427702:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789478544.427707:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed000/0x8ebaae74e8215d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8215d3a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478544.427714:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc421ed000 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478544.427717:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed000/0x8ebaae74e8215d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8215d3a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478544.427723:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed000/0x8ebaae74e8215d33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ebaae74e8215d3a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478544.427739:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed000/0x8ebaae74e8215d33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ebaae74e8215d3a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478544.427745:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789478544.427747:0:8447:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789478544.427749:0:8447:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789478544.427772:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed000/0x8ebaae74e8215d33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e8215d3a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478544.427777:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478544.427799:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed000/0x8ebaae74e8215d33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e8215d3a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478544.427805:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc421ed000/0x8ebaae74e8215d33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e8215d3a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478544.427814:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789478544.427817:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8216097 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e821609e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478544.427822:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b66e00 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478544.427825:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8216097 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e821609e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478544.427832:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8216097 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ebaae74e821609e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478544.427838:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8216097 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ebaae74e821609e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478544.427844:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789478544.427846:0:8447:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789478544.427848:0:8447:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789478544.427859:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8216097 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e821609e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478544.427865:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478544.427871:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8216097 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e821609e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478544.427882:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66e00/0x8ebaae74e8216097 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e821609e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478544.427892:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789478544.427973:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb044b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964493952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789478544.428011:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478544.428032:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789478544.428037:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb044b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964494080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789478544.428056:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478544.428094:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964493824 00000100:00100000:2.0:1789478544.428099:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964493824 00000100:00100000:2.0:1789478544.428136:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964493952 00000100:00100000:2.0:1789478544.428138:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964493952 00000100:00100000:2.0:1789478544.428153:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964494080 00000100:00100000:2.0:1789478544.428155:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964494080 00000100:00100000:2.0:1789478544.428180:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789478544.428188:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+25:3646:x1876403964493824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789478544.428201:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478544.428213:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc35b66000/0x8ebaae74e8215e44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ebaae74e8215e3d expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478544.428224:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478544.428256:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+24:3646:x1876403964493824:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478544.428262:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789478544.428276:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789478544.428281:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+23:3647:x1876403964493952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789478544.428288:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478544.428295:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc35b67800/0x8ebaae74e8215d3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ebaae74e8215d33 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478544.428308:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478544.428334:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+22:3647:x1876403964493952:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478544.428340:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789478544.428353:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789478544.428358:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+21:3647:x1876403964494080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789478544.428366:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478544.428374:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebb035fc800/0x8ebaae74e821609e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ebaae74e8216097 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478544.428381:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478544.428400:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+20:3647:x1876403964494080:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478544.428406:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789478544.428435:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb044b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964494080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789478544.428443:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb044b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c56e5039-4535-4d8a-bd01-962355b55f9c:3647:1876403964493952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789478544.428465:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb044b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964493824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789478544.428640:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec600/0x8ebaae74e82158ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e82158f6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478544.428649:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc421ec600 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478544.428653:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec600/0x8ebaae74e82158ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e82158f6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478544.428661:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec600/0x8ebaae74e82158ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ebaae74e82158f6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478544.428667:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec600/0x8ebaae74e82158ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ebaae74e82158f6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478544.428672:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789478544.428674:0:8447:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789478544.428677:0:8447:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789478544.428694:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec600/0x8ebaae74e82158ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e82158f6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478544.428700:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478544.428714:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec600/0x8ebaae74e82158ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e82158f6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478544.428720:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec600/0x8ebaae74e82158ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e82158f6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478544.428751:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478544.428753:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478544.428754:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478544.428773:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478544.428778:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478544.428964:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789478544.428975:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb044b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964494208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789478544.429014:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478544.429216:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964494208 00000100:00100000:0.0:1789478544.429223:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964494208 00000020:01000004:1.0:1789478544.429260:0:15248:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1789478544.429264:0:15248:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000100:00100000:0.0:1789478544.429265:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000020:00000080:1.0:1789478544.429272:0:15248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000100:00100000:0.0:1789478544.429276:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+20:3646:x1876403964494208:12345-0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1789478544.429279:0:15248:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1789478544.429286:0:15248:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ebc3f68d000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1789478544.429287:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:1.0:1789478544.429295:0:15248:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ebb01bdf800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1789478544.429301:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc029dfe00/0x8ebaae74e82158f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ebaae74e82158ef expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789478544.429302:0:15248:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ebc35b1d800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1789478544.429313:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478544.429346:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c56e5039-4535-4d8a-bd01-962355b55f9c+19:3646:x1876403964494208:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478544.429352:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789478544.429378:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb044b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964494208:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1789478544.429764:0:15248:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ebc359b9000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1789478544.429771:0:15248:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8ebc40fbb000 6a1d5e8d-e61d-452f-a651-9ee87fa9267a 192.168.206.11@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789478544.429776:0:15248:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8ebb034e4800 327dd6d5-45fd-4b52-99bf-74d27d1ede6e 192.168.206.11@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:1.0:1789478544.429782:0:15248:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8ebc091a3370) has exports, disconnecting them 00000020:00080000:1.0:1789478544.429786:0:15248:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ebc3f68d000), last request at 1789478543 00000020:00000080:1.0:1789478544.429792:0:15248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215ca0 00000100:00080000:1.0:1789478544.429880:0:15248:0:(import.c:65:import_set_state_nolock()) ffff8ebc3f688000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789478544.429972:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789478544.430101:0:15248:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ebc3f68d000): rc 0 00000020:00000080:1.0:1789478544.430104:0:15248:0:(genops.c:885:class_export_put()) final put ffff8ebc3f68d000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1789478544.430121:0:15248:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ebb01bdf800), last request at 1789478543 00000020:00000080:1.0:1789478544.430125:0:15248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215b7a 00000100:00080000:1.0:1789478544.430131:0:15248:0:(import.c:65:import_set_state_nolock()) ffff8ebb01bdb000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789478544.430165:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc3f68d000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00080000:1.0:1789478544.430200:0:15248:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ebb01bdf800): rc 0 00000020:00000080:1.0:1789478544.430204:0:15248:0:(genops.c:885:class_export_put()) final put ffff8ebb01bdf800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1789478544.430210:0:15248:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ebc35b1d800), last request at 1789478348 00000020:00000080:1.0:1789478544.430214:0:15248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215ab6 00000100:00080000:1.0:1789478544.430220:0:15248:0:(import.c:65:import_set_state_nolock()) ffff8ebc35b19800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789478544.430225:0:14273:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc3f688000 for lustre-MDT0000 00000020:00000080:3.0:1789478544.430274:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebb01bdf800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:0.0:1789478544.430303:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789478544.430308:0:14273:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebb01bdb000 for lustre-MDT0000 00000020:00080000:1.0:1789478544.430364:0:15248:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ebc35b1d800): rc 0 00000020:00000080:1.0:1789478544.430367:0:15248:0:(genops.c:885:class_export_put()) final put ffff8ebc35b1d800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1789478544.430381:0:15248:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ebc359b9000), last request at 1789478348 00000020:00000080:1.0:1789478544.430386:0:15248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215a54 00000100:00080000:1.0:1789478544.430390:0:15248:0:(import.c:65:import_set_state_nolock()) ffff8ebc38590800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789478544.430407:0:15248:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00000080:2.0:1789478544.430478:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc35b1d800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00080000:1.0:1789478544.430478:0:15248:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ebc359b9000): rc 0 00000004:00000080:1.0:1789478544.430485:0:15248:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9dd90556fae0 00000100:00080000:1.0:1789478544.430504:0:15248:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000020:00000080:2.0:1789478544.430506:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc35b19800 for lustre-MDT0000 00000100:00100000:1.0:1789478544.430508:0:15248:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:3.0:1789478544.430541:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478544.432238:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789478544.433698:0:15248:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789478544.433727:0:15248:0:(import.c:65:import_set_state_nolock()) ffff8ebc35bd9000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789478544.433801:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964494336:0@lo:39:umount.0 00000100:00100000:0.0:1789478544.433861:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789478544.434065:0:15248:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789478544.434070:0:15248:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1789478544.434099:0:15248:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789478544.434155:0:15248:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789478544.434168:0:15248:0:(import.c:65:import_set_state_nolock()) ffff8ebc3f68e000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789478544.434197:0:15248:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789478544.434200:0:15248:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1789478544.434215:0:15248:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789478544.434265:0:15248:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789478544.434279:0:15248:0:(import.c:65:import_set_state_nolock()) ffff8ebc359bd800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789478544.434279:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964494464:0@lo:9:umount.0 00000020:00080000:2.0:1789478544.434307:0:15248:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8ebc091a3370) has no exports 00000100:00100000:0.0:1789478544.434318:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478544.434342:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964494592:0@lo:9:umount.0 00000100:00100000:2.0:1789478544.434345:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964494464 00000100:00100000:2.0:1789478544.434351:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964494464 00000100:00100000:0.0:1789478544.434371:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478544.434388:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964494592 00000100:00100000:2.0:1789478544.434391:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964494592 00000100:00100000:0.0:1789478544.434402:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789478544.434410:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876403964494464:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789478544.434554:0:8829:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215c22 00000100:00080000:0.0:1789478544.434561:0:8829:0:(import.c:65:import_set_state_nolock()) ffff8ebb01b62000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789478544.434658:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964494336 00000100:00100000:1.0:1789478544.434663:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964494336 00000001:00000004:0.0:1789478544.434668:0:8829:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1789478544.434690:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789478544.434696:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876403964494336:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789478544.434711:0:7991:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215ac4 00000100:00080000:1.0:1789478544.434721:0:7991:0:(import.c:65:import_set_state_nolock()) ffff8ebc40e09000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789478544.434792:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3644:x1876403964494464:12345-0@lo:9:umount.0 Request processed in 382us (483us total) trans 0 rc 0/0 00010000:00010000:3.0:1789478544.434824:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478544.435180:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789478544.435189:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876403964494592:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789478544.435201:0:8430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215d64 00000100:00080000:2.0:1789478544.435206:0:8430:0:(import.c:65:import_set_state_nolock()) ffff8ebb034e5800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789478544.435228:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1789478544.435292:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3644:x1876403964494592:12345-0@lo:9:umount.0 Request processed in 105us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478544.435298:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789478544.435747:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1789478544.435788:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc359bd800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789478544.435800:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789478544.435802:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789478544.435806:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964494592:0@lo:9:umount.0 00000100:00080000:0.0:1789478544.435818:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc3f68e000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789478544.435825:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789478544.435827:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789478544.435829:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964494464:0@lo:9:umount.0 00010000:00010000:0.0:1789478544.436111:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1789478544.436183:0:7991:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1789478544.436302:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3644:x1876403964494336:12345-0@lo:39:umount.0 Request processed in 1605us (2440us total) trans 4294967301 rc 0/0 00000100:00080000:0.0:1789478544.436397:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc35bd9000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789478544.436403:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964494336:0@lo:39:umount.0 00000100:00100000:1.0:1789478544.436480:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00010000:00010000:3.0:1789478544.436773:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789478544.444307:0:15248:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8ebc091a3370) has no exports 00000020:00000080:2.0:1789478544.493214:0:15248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e821594a 00000020:00000080:2.0:1789478544.493237:0:15248:0:(genops.c:885:class_export_put()) final put ffff8ebc0837e000/lustre-QMT0000_UUID 00000020:01000000:2.0:1789478544.493265:0:15248:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1789478544.493650:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc0837e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1789478544.493687:0:15248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789478544.493696:0:15248:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789478544.493701:0:15248:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8ebc34c719b8) has no exports 00000020:00000080:3.0:1789478544.494250:0:15248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215943 00000020:00000080:3.0:1789478544.494257:0:15248:0:(genops.c:885:class_export_put()) final put ffff8ebc34c68800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789478544.494500:0:15248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789478544.494509:0:15248:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789478544.494512:0:15248:0:(genops.c:885:class_export_put()) final put ffff8ebc34c6a800/lustre-QMT0000_UUID 00000020:00000080:3.0:1789478544.494515:0:15248:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc34c6a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1789478544.494519:0:15248:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1789478544.494617:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc34c68800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1789478544.934317:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478545.957711:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478546.661495:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789478546.661518:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964494720:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789478546.662474:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478546.662520:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964494720 00000100:00100000:3.0:1789478546.662527:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964494720 00000100:00100000:3.0:1789478546.662573:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789478546.662582:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964494720:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789478546.662758:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789478546.665251:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000001:00100000:2.0:1789478546.665459:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789478546.665464:0:8425:0:(genops.c:885:class_export_put()) final put ffff8ebb01b63000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789478546.665478:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 327dd6d5-45fd-4b52-99bf-74d27d1ede6e 00000020:00000080:2.0:1789478546.665481:0:8425:0:(genops.c:885:class_export_put()) final put ffff8ebb03d76800/327dd6d5-45fd-4b52-99bf-74d27d1ede6e 00000020:00000080:2.0:1789478546.665505:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebb01b63000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789478546.665549:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebb03d76800/327dd6d5-45fd-4b52-99bf-74d27d1ede6e for lustre-OST0000 00000020:00000080:2.0:1789478546.665562:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebb01b62000 for lustre-OST0000 00000020:00000080:2.0:1789478546.665568:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebb03d71000 for lustre-OST0000 00000001:00100000:1.0:1789478546.665676:0:6496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789478546.665680:0:6496:0:(genops.c:885:class_export_put()) final put ffff8ebc359b9000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789478546.665693:0:6496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6a1d5e8d-e61d-452f-a651-9ee87fa9267a 00000001:00080000:1.0:1789478546.665701:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1789478546.665703:0:6496:0:(genops.c:885:class_export_put()) final put ffff8ebc40fbb000/6a1d5e8d-e61d-452f-a651-9ee87fa9267a 00000001:00100000:1.0:1789478546.665709:0:6496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 327dd6d5-45fd-4b52-99bf-74d27d1ede6e 00000001:00080000:1.0:1789478546.665712:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1789478546.665718:0:6496:0:(genops.c:885:class_export_put()) final put ffff8ebb034e4800/327dd6d5-45fd-4b52-99bf-74d27d1ede6e 00000100:00100000:0.0:1789478546.665744:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964494720:0@lo:13:osp-pre-0-1.0 00000020:00000080:2.0:1789478546.665762:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc359b9000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000100:00100000:3.0:1789478546.665866:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964494720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3283us (3391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478546.665874:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000020:00000080:2.0:1789478546.666075:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc40fbb000/6a1d5e8d-e61d-452f-a651-9ee87fa9267a for lustre-MDT0000 00000020:00000080:2.0:1789478546.666108:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebb034e4800/327dd6d5-45fd-4b52-99bf-74d27d1ede6e for lustre-MDT0000 00000020:00000080:2.0:1789478546.666135:0:14273:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc38590800 for lustre-MDT0000 00000020:00000080:2.0:1789478546.666139:0:14273:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc40fbd800 for lustre-MDT0000 00000020:00000080:2.0:1789478546.666142:0:14273:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebb034e2800 for lustre-MDT0000 00000001:00100000:3.0:1789478546.666210:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789478546.666214:0:9510:0:(genops.c:885:class_export_put()) final put ffff8ebb034e3800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789478546.666256:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 327dd6d5-45fd-4b52-99bf-74d27d1ede6e 00000020:00000080:3.0:1789478546.666259:0:9510:0:(genops.c:885:class_export_put()) final put ffff8ebc056d8000/327dd6d5-45fd-4b52-99bf-74d27d1ede6e 00000020:00000080:1.0:1789478546.666282:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebb034e3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789478546.666314:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebb034e5800 for lustre-OST0001 00000001:00100000:0.0:1789478546.666328:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1789478546.666335:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1789478546.666338:0:7448:0:(genops.c:885:class_export_put()) final put ffff8ebc40e0c800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789478546.666394:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6a1d5e8d-e61d-452f-a651-9ee87fa9267a 00000001:00080000:0.0:1789478546.666399:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1789478546.666401:0:7448:0:(genops.c:885:class_export_put()) final put ffff8ebc40fba000/6a1d5e8d-e61d-452f-a651-9ee87fa9267a 00000001:00100000:0.0:1789478546.666405:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 327dd6d5-45fd-4b52-99bf-74d27d1ede6e 00000001:00080000:0.0:1789478546.666410:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1789478546.666411:0:7448:0:(genops.c:885:class_export_put()) final put ffff8ebb034e7000/327dd6d5-45fd-4b52-99bf-74d27d1ede6e 00000020:00000080:2.0:1789478546.666557:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc40e0c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1789478546.666585:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc40fba000/6a1d5e8d-e61d-452f-a651-9ee87fa9267a for lustre-MDT0001 00000020:00000080:2.0:1789478546.666620:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebb034e7000/327dd6d5-45fd-4b52-99bf-74d27d1ede6e for lustre-MDT0001 00000020:00000080:2.0:1789478546.666896:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc056d8000/327dd6d5-45fd-4b52-99bf-74d27d1ede6e for lustre-OST0001 00000020:00000080:2.0:1789478546.666913:0:14273:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc40e09000 for lustre-MDT0001 00000020:00000080:2.0:1789478546.666917:0:14273:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc40fba800 for lustre-MDT0001 00000020:00000080:2.0:1789478546.666920:0:14273:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebb034e2000 for lustre-MDT0001 00000020:00000080:2.0:1789478546.666923:0:14273:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc056db800 for lustre-OST0001 00000040:00080000:0.0:1789478546.789543:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789478546.980799:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478548.005352:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478548.196785:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789478548.196816:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964494848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789478548.196882:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478548.197263:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964494848 00000100:00100000:3.0:1789478548.197270:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964494848 00000100:00100000:1.0:1789478548.197522:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876403964495232:0@lo:400:kworker.0 00000100:00100000:1.0:1789478548.197556:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478548.197582:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964494976:0@lo:400:kworker.0 00000100:00100000:1.0:1789478548.197609:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876403964495744:0@lo:400:kworker.0 00000100:00100000:1.0:1789478548.197644:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478548.197657:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478548.197722:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964495360:0@lo:400:kworker.0 00000100:00100000:3.0:1789478548.198011:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789478548.198018:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1876403964494848:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1789478548.198026:0:6522:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789478548.198199:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789478548.198206:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876403964495104:0@lo:400:kworker.0 00000100:00100000:1.0:1789478548.198230:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478548.198263:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876403964495616:0@lo:400:kworker.0 00000100:00100000:1.0:1789478548.198284:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478548.198313:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964494976 00000100:00100000:1.0:1789478548.198318:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964494976 00000100:00100000:1.0:1789478548.198362:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1789478548.198368:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc101ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+19:3648:x1876403964494976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478548.198406:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc101ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c56e5039-4535-4d8a-bd01-962355b55f9c+19:3648:x1876403964494976:12345-0@lo:400:kworker.0 Request processed in 38us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478548.198412:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1789478548.198444:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964495232 00000100:00100000:1.0:1789478548.198448:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964495232 00000100:00100000:1.0:1789478548.198468:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964495744 00000100:00100000:1.0:1789478548.198471:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964495744 00000100:00100000:1.0:1789478548.198492:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964495104 00000100:00100000:1.0:1789478548.198495:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964495104 00000100:00100000:1.0:1789478548.198502:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964495616 00000100:00100000:1.0:1789478548.198504:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964495616 00000100:00100000:1.0:1789478548.198513:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789478548.198519:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876403964495744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478548.198557:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876403964495744:12345-0@lo:400:kworker.0 Request processed in 39us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478548.198563:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789478548.198577:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789478548.198581:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1876403964495232:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789478548.198585:0:6517:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789478548.198628:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1876403964495232:12345-0@lo:400:kworker.0 Request processed in 45us (1071us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789478548.198634:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789478548.198646:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789478548.198649:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1876403964495104:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789478548.198964:0:6517:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789478548.199004:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1876403964495104:12345-0@lo:400:kworker.0 Request processed in 353us (772us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789478548.199017:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789478548.199031:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789478548.199035:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1876403964495616:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789478548.199039:0:6517:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789478548.199064:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1876403964495616:12345-0@lo:400:kworker.0 Request processed in 27us (779us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789478548.199069:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:1.0:1789478548.199732:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789478548.199770:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789478548.199777:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ebc3bcdf000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789478548.199780:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1789478548.201224:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964494976:0@lo:400:kworker.0 00000100:00100000:0.0:1789478548.201437:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964495488:0@lo:400:kworker.0 00000100:00100000:0.0:1789478548.201491:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478548.201640:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964495488 00000100:00100000:0.0:1789478548.201647:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964495488 00000100:00100000:0.0:1789478548.201698:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789478548.201708:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964495488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478548.201758:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964495488:12345-0@lo:400:kworker.0 Request processed in 52us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478548.201765:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789478548.201971:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964495488:0@lo:400:kworker.0 00000100:00080000:0.0:1789478548.201994:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789478548.205776:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478548.205852:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964495872:0@lo:400:kworker.0 00000100:00100000:2.0:1789478548.205894:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478548.205951:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964495872 00000100:00100000:2.0:1789478548.205960:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964495872 00000100:00100000:2.0:1789478548.206029:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789478548.206039:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964495872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478548.206335:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964495872:12345-0@lo:400:kworker.0 Request processed in 296us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478548.206343:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:2.0:1789478548.206371:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789478548.206393:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1876403964494848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8371us (9508us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789478548.206403:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964495872:0@lo:400:kworker.0 00000100:00100000:3.0:1789478548.206417:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:02020000:3.0:1789478548.206457:0:3648:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:0.0:1789478548.206527:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964495360 00000100:00100000:0.0:1789478548.206532:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964495360 00000100:00100000:0.0:1789478548.206608:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1789478548.206616:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964495360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478548.206658:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964495360:12345-0@lo:400:kworker.0 Request processed in 44us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478548.206664:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00080000:2.0:1789478548.206742:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789478548.206763:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb037e5180 x1876403964495360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478548.206775:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964495360:0@lo:400:kworker.0 00000100:00080000:1.0:1789478548.213526:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ebc3bcdf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789478548.213536:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 177 00000100:00080000:1.0:1789478548.213550:0:3646:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ebc3bcdf000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1789478548.213587:0:3646:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb037e6a00 x1876403964496000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789478548.213726:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876403964495104:0@lo:400:kworker.0 00000100:00080000:1.0:1789478548.213757:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789478548.213761:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ebc40ca8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789478548.213765:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789478548.213768:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ebc40ca8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789478548.213771:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 215 00000100:00080000:1.0:1789478548.213776:0:3646:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ebc40ca8000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1789478548.213815:0:3646:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb037e7100 x1876403964496128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789478548.213826:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876403964495616:0@lo:400:kworker.0 00000100:00080000:1.0:1789478548.213841:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789478548.213844:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ebc091ab000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789478548.213847:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789478548.213850:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ebc091ab000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789478548.213853:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 194 00000100:00080000:1.0:1789478548.213857:0:3646:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ebc091ab000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1789478548.213871:0:3646:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb037e5500 x1876403964496256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789478548.213881:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876403964495232:0@lo:400:kworker.0 00010000:00080000:1.0:1789478548.213894:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb037e4e00 x1876403964495744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478548.213904:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876403964495744:0@lo:400:kworker.0 00000100:00100000:0.0:1789478548.214102:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876403964496000:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789478548.214167:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478548.214199:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876403964496128:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789478548.214219:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478548.214234:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876403964496256:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789478548.214263:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478548.214295:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964496000 00000100:00100000:0.0:1789478548.214300:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964496000 00000100:00100000:0.0:1789478548.214325:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964496128 00000100:00100000:0.0:1789478548.214327:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964496128 00000100:00100000:0.0:1789478548.214336:0:13638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964496256 00000100:00100000:0.0:1789478548.214338:0:13638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964496256 00000100:00100000:0.0:1789478548.214349:0:13638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789478548.214355:0:13638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1876403964496000:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1789478548.214369:0:13638:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789478548.214419:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789478548.214424:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876403964496128:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1789478548.214431:0:6519:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789478548.214470:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876403964496128:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 45us (249us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789478548.214477:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789478548.214494:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789478548.214498:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876403964496256:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1789478548.214512:0:6519:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789478548.214536:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876403964496256:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 37us (272us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789478548.214542:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1789478548.214613:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc40ca8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789478548.214618:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789478548.214621:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876403964496128:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1789478548.214631:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc091ab000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789478548.214634:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789478548.214636:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876403964496256:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1789478548.224044:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789478548.224051:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8ebc3bd0f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789478548.224070:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789478548.224076:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8ebc3bd0f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789478548.224079:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 177 00000100:00080000:3.0:1789478548.224104:0:3648:0:(import.c:625:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ebc3bd0f000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1789478548.224138:0:3648:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb0359bb80 x1876403964496384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789478548.225775:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964496384:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789478548.225857:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478548.226938:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964496384 00000100:00100000:2.0:1789478548.226948:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964496384 00000100:00100000:2.0:1789478548.226995:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789478548.227003:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876403964496384:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1789478548.227019:0:6523:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789478548.227076:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876403964496384:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 71us (1218us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789478548.227095:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:2.0:1789478548.227142:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc3bd0f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789478548.227147:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789478548.227286:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964496384:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1789478548.239561:0:13638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1876403964496000:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 25199us (25388us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789478548.239573:0:13638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:2.0:1789478548.239867:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc3bcdf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789478548.239874:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789478548.239878:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876403964496000:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789478548.709768:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964496512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789478548.709839:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478548.710652:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964496512 00000100:00100000:1.0:1789478548.710660:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964496512 00000100:00100000:1.0:1789478548.710714:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789478548.710724:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964496512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789478548.710751:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789478548.710812:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964496512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478548.710819:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789478548.710914:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964496512:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789478549.031048:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478550.052972:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789478550.564723:0:15248:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ebb034452a0 - data ffff8ebc31b22948/ffff8ebc08933c00 00000020:01000000:3.0:1789478550.564862:0:15248:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ebc04df8660 - data ffff8ebc31980948/ffff8ebc34de5800 00000001:00000004:3.0:1789478550.573005:0:15248:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:2.0:1789478550.631277:0:15248:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789478550.631284:0:15248:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1789478550.631306:0:15248:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8ebb03ffed80 x1876403964494336/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789478554 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478550.631329:0:15248:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789478550.633313:0:15248:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789478550.633318:0:15248:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1789478550.633334:0:15248:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789478550.633337:0:15248:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789478550.633567:0:8827:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789478550.633583:0:8827:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1789478550.633616:0:8827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789478550.634577:0:15248:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789478550.634582:0:15248:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1789478550.634684:0:15248:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789478550.634686:0:15248:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789478550.635212:0:9997:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789478550.635217:0:9997:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1789478550.635224:0:9997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789478550.637071:0:15248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215912 00000020:00000080:2.0:1789478550.637082:0:15248:0:(genops.c:885:class_export_put()) final put ffff8ebc18906800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789478550.637147:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc18906800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789478550.644174:0:15248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215927 00000020:00000080:1.0:1789478550.644186:0:15248:0:(genops.c:885:class_export_put()) final put ffff8ebc091ae000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789478550.644630:0:15248:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789478550.644636:0:15248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789478550.644654:0:15248:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789478550.644665:0:15248:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8ebc091a19b8) has no exports 00000020:00000080:2.0:1789478550.645063:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc091ae000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1789478550.645163:0:15248:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789478550.645170:0:15248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215d5d 00000020:00000080:1.0:1789478550.645175:0:15248:0:(genops.c:885:class_export_put()) final put ffff8ebb034e4000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789478550.645188:0:15248:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789478550.645192:0:15248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789478550.645338:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebb034e4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789478550.645373:0:15248:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789478550.645377:0:15248:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff8ebc3f733370) has no exports 00000020:00000080:1.0:1789478550.645383:0:15248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215d56 00000020:00000080:1.0:1789478550.645388:0:15248:0:(genops.c:885:class_export_put()) final put ffff8ebc3bcd8800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789478550.645673:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc3bcd8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789478550.646128:0:15248:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789478550.646133:0:15248:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789478550.646145:0:15248:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1789478550.646150:0:15248:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789478550.646153:0:15248:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789478550.646221:0:15248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789478550.646231:0:15248:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789478550.646236:0:15248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215c1b 00000020:00000080:1.0:1789478550.646241:0:15248:0:(genops.c:885:class_export_put()) final put ffff8ebb01b67800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789478550.646245:0:15248:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789478550.646249:0:15248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789478550.646253:0:15248:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789478550.646256:0:15248:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8ebc3bd119b8) has no exports 00000020:00000080:1.0:1789478550.646259:0:15248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215c14 00000020:00000080:1.0:1789478550.646262:0:15248:0:(genops.c:885:class_export_put()) final put ffff8ebc3f68a000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789478550.646552:0:15248:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789478550.646555:0:15248:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789478550.646557:0:15248:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1789478550.646561:0:15248:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789478550.646562:0:15248:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789478550.646583:0:15248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789478550.646589:0:15248:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1789478550.646628:0:15248:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789478550.646633:0:15248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215a8c 00000020:00000080:1.0:1789478550.646637:0:15248:0:(genops.c:885:class_export_put()) final put ffff8ebc34e1b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789478550.647091:0:15248:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1789478550.647096:0:15248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789478550.647102:0:15248:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789478550.647105:0:15248:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8ebc34c74d28) has no exports 00000020:00000080:1.0:1789478550.647110:0:15248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215a70 00000020:00000080:1.0:1789478550.647114:0:15248:0:(genops.c:885:class_export_put()) final put ffff8ebc35bd8000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789478550.647467:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc359bd800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789478550.647475:0:36:0:(genops.c:885:class_export_put()) final put ffff8ebc3bcdb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789478550.647477:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc3bcdb000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1789478550.647481:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789478550.647548:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebb01b67800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789478550.647553:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc3f68a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789478550.647557:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc3f68e000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789478550.647561:0:36:0:(genops.c:885:class_export_put()) final put ffff8ebc35e74800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789478550.647563:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc35e74800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1789478550.647565:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789478550.647587:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc34e1b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1789478550.647590:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc35bd8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789478550.653506:0:15248:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1789478550.653514:0:15248:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789478550.653518:0:15248:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789478550.653526:0:15248:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789478550.653581:0:15248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789478550.653609:0:15248:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789478550.653636:0:15248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789478550.653650:0:15248:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789478550.653655:0:15248:0:(genops.c:885:class_export_put()) final put ffff8ebc38593800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789478550.653659:0:15248:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc38593800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789478550.653665:0:15248:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789478550.653761:0:15248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e821592e 00000020:00000080:0.0:1789478550.653767:0:15248:0:(genops.c:885:class_export_put()) final put ffff8ebc091aa000/lustre-MDD0000_UUID 00000020:01000000:0.0:1789478550.653772:0:15248:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789478550.653776:0:15248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789478550.653780:0:15248:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789478550.653795:0:15248:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8ebc091a4d28) has no exports 00000020:00000080:0.0:1789478550.653813:0:15248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789478550.653816:0:15248:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789478550.653820:0:15248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215935 00000020:00000080:0.0:1789478550.653824:0:15248:0:(genops.c:885:class_export_put()) final put ffff8ebc091ac800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789478550.653832:0:15248:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ebc0501d800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789478550.653835:0:15248:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ebc0501d800 3 00000020:01000004:0.0:1789478550.653838:0:15248:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ebc0501d800 from lustre-MDT0000 00000020:00000080:0.0:1789478550.653854:0:15248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789478550.653857:0:15248:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789478550.653859:0:15248:0:(genops.c:885:class_export_put()) final put ffff8ebc18901000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789478550.653881:0:15248:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc18901000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789478550.653887:0:15248:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789478550.653916:0:15248:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1789478550.653921:0:15248:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789478550.653924:0:15248:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789478550.653926:0:15248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789478550.653929:0:15248:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789478550.653936:0:15248:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8ebc18906000 c56e5039-4535-4d8a-bd01-962355b55f9c 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789478550.653941:0:15248:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8ebc08d919b8) has exports, disconnecting them 00000020:00080000:0.0:1789478550.653945:0:15248:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8ebc18906000), last request at 1789478333 00000020:00000080:0.0:1789478550.653959:0:15248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e82158d3 00000020:00010000:0.0:1789478550.653963:0:15248:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ebc18906000: total 2 00000100:00080000:0.0:1789478550.653966:0:15248:0:(import.c:65:import_set_state_nolock()) ffff8ebc18900000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789478550.653984:0:15248:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ebc18906000): rc 0 00000020:00080000:0.0:1789478550.653988:0:15248:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8ebc08d919b8) has no exports 00000100:00100000:0.0:1789478550.654193:0:6511:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8ebc2c12b800:6511] 1 exiting: rc = 0 00000100:00100000:0.0:1789478550.654355:0:6510:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8ebc2c12a200:6510] 0 exiting: rc = 1 00000100:00100000:0.0:1789478550.654412:0:6512:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8ebc089c9600:6512] 2 exiting: rc = 0 00000100:00100000:0.0:1789478550.654465:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654472:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654477:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654483:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654489:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654495:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654500:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654505:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654512:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654517:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654524:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654530:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654536:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654542:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654555:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789478550.654705:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc35bd9000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1789478550.654712:0:36:0:(genops.c:885:class_export_put()) final put ffff8ebc35b1b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789478550.654715:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc35b1b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1789478550.654719:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789478550.654770:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc091aa000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1789478550.654774:0:36:0:(genops.c:885:class_export_put()) final put ffff8ebc091a8000/lustre-MDD0000_UUID 00000020:00000080:2.0:1789478550.654776:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc091a8000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1789478550.654779:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000100:00100000:0.0:1789478550.654919:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654929:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654934:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654939:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654944:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654949:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654954:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654960:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654964:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654969:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654974:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654979:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654987:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.654997:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655068:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655075:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655080:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655086:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655092:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655097:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655102:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655108:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655113:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655118:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655123:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655128:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655133:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655149:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655155:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655161:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655167:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655172:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655177:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655182:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655206:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789478550.655366:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc091ac800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1789478550.655455:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655461:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655466:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655470:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655475:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655479:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655484:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655488:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655493:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655498:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655503:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655509:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655514:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478550.655520:0:15248:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:0.0:1789478550.656557:0:6506:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ebc18906000: total 0 00010000:00010000:0.0:1789478550.656617:0:6506:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ebc18906000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789478550.656660:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc40fcec00/0x8ebaae74e8215dfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ebaae74e8215df7 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478550.656677:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc35b67000/0x8ebaae74e8215df0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ebaae74e8215de9 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478550.656688:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc00031a00/0x8ebaae74e82159cf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ebaae74e82159c8 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478550.656704:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc34f77c00/0x8ebaae74e8215e0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ebaae74e8215e05 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478550.656714:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc00031000/0x8ebaae74e8215e1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ebaae74e8215e13 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478550.656723:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebb035fda00/0x8ebaae74e8215e28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ebaae74e8215e21 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478550.656744:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc42177200/0x8ebaae74e82159dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ebaae74e82159d6 expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478550.656757:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc40fcf000/0x8ebaae74e8216074 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ebaae74e821606d expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478550.656767:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc40fcfa00/0x8ebaae74e8216082 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ebaae74e821607b expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478550.656776:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebb035fcc00/0x8ebaae74e8215e52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ebaae74e8215e4b expref: 5 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478550.656796:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc00031800/0x8ebaae74e8215de2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ebaae74e8215ddb expref: 4 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478550.656812:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc35b67200/0x8ebaae74e8216090 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ebaae74e8216089 expref: 3 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478550.656823:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc42177800/0x8ebaae74e8215cf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ebaae74e8215ced expref: 2 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478550.656833:0:6506:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ebc18906000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1789478550.656847:0:6506:0:(genops.c:885:class_export_put()) final put ffff8ebc18906000/c56e5039-4535-4d8a-bd01-962355b55f9c 00010000:00010000:0.0:1789478550.656862:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478550.656877:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478550.656879:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789478550.657245:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc18906000/c56e5039-4535-4d8a-bd01-962355b55f9c for MGS 00000020:00000080:2.0:1789478550.657272:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc18900000 for MGS 00000020:01000000:0.0:1789478550.657748:0:15248:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ebb03445cc0 - data ffff8ebc31b22a20/ffff8ebb03397000 00000020:01000000:0.0:1789478550.657994:0:15248:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ebc08c14d20 - data ffff8ebc11cae438/ffff8ebc03207000 00000020:00000080:0.0:1789478550.658582:0:15248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e82158b7 00000020:00000080:0.0:1789478550.662174:0:15248:0:(genops.c:885:class_export_put()) final put ffff8ebc187d8800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789478550.662194:0:15248:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ebc0501d800 from MGS, refs=2 00000020:01000004:0.0:1789478550.662327:0:15248:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ebc0501d800 2 00000020:01000004:0.0:1789478550.662331:0:15248:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ebc0501d800 from MGS 00000020:00000080:0.0:1789478550.662357:0:15248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789478550.662365:0:15248:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789478550.662368:0:15248:0:(genops.c:885:class_export_put()) final put ffff8ebc187dd800/MGS 00000020:00000080:0.0:1789478550.662371:0:15248:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc187dd800/MGS for MGS 00000020:01000000:0.0:1789478550.662379:0:15248:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1789478550.662446:0:15248:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789478550.662450:0:15248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789478550.662455:0:15248:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789478550.662461:0:15248:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8ebc0837d000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789478550.662466:0:15248:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8ebc08d90000) has exports, disconnecting them 00000020:00080000:0.0:1789478550.662470:0:15248:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8ebc0837d000), last request at 1789478333 00000020:00000080:0.0:1789478550.662538:0:15248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215982 00000020:00080000:0.0:1789478550.662549:0:15248:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ebc0837d000): rc 0 00000020:00000080:0.0:1789478550.662554:0:15248:0:(genops.c:885:class_export_put()) final put ffff8ebc0837d000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789478550.665931:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc187d8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789478550.665945:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc0837d000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1789478550.681497:0:15248:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789478550.681505:0:15248:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789478550.681509:0:15248:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789478550.681516:0:15248:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789478550.681581:0:14273:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc0837f000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789478550.681729:0:15248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789478550.681738:0:15248:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789478550.681743:0:15248:0:(genops.c:885:class_export_put()) final put ffff8ebc0837c000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789478550.681747:0:15248:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc0837c000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789478550.681768:0:15248:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789478550.681846:0:15248:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ebc0501d800 1 00000020:00000080:1.0:1789478550.681851:0:15248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e82158a9 00000020:00000080:1.0:1789478550.681857:0:15248:0:(genops.c:885:class_export_put()) final put ffff8ebc187d9800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1789478550.681862:0:15248:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789478550.681865:0:15248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789478550.681869:0:15248:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789478550.681873:0:15248:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8ebc0658b370) has no exports 00000020:00000080:2.0:1789478550.681936:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc187d9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789478550.745902:0:15248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789478550.745916:0:15248:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1789478550.745921:0:15248:0:(genops.c:885:class_export_put()) final put ffff8ebc05019800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789478550.745926:0:15248:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc05019800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789478550.745935:0:15248:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1789478550.746207:0:15248:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ebc0501e000 00000020:02000400:2.0:1789478550.746261:0:15248:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1789478551.079105:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478551.780829:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964496640:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789478551.780891:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478551.780959:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964496640 00000100:00100000:2.0:1789478551.780965:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964496640 00000100:00100000:2.0:1789478551.781013:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789478551.781027:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964496640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789478551.781064:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789478551.781106:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964496640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (215us total) trans 0 rc 0/0 00000100:00080000:3.0:1789478551.782866:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789478551.782917:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964496640:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789478551.788493:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00010000:00010000:3.0:1789478552.100724:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478553.125018:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789478553.317233:0:14273:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789478553.317239:0:14273:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789478553.317243:0:14273:0:(import.c:65:import_set_state_nolock()) ffff8ebc3bd0f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789478553.317251:0:14273:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 377 00000100:00080000:0.0:1789478553.317256:0:14273:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789478553.317265:0:14273:0:(import.c:625:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ebc3bd0f000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1789478553.317285:0:14273:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb03ffed80 x1876403964496896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789478553.317300:0:14273:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789478553.317303:0:14273:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789478553.317313:0:14273:0:(import.c:65:import_set_state_nolock()) ffff8ebc3bcdf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789478553.317317:0:14273:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 377 00000100:00080000:0.0:1789478553.317319:0:14273:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789478553.317323:0:14273:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ebc3bcdf000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1789478553.317334:0:14273:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb03ffc380 x1876403964497024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789478553.317342:0:14273:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789478553.317345:0:14273:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789478553.317346:0:14273:0:(import.c:65:import_set_state_nolock()) ffff8ebc091ab000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789478553.317349:0:14273:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 377 00000100:00080000:0.0:1789478553.317351:0:14273:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789478553.317354:0:14273:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ebc091ab000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1789478553.317361:0:14273:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb03ffd500 x1876403964497152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789478553.317386:0:14273:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789478553.317389:0:14273:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789478553.317390:0:14273:0:(import.c:65:import_set_state_nolock()) ffff8ebc40ca8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789478553.317393:0:14273:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 377 00000100:00080000:0.0:1789478553.317395:0:14273:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789478553.317398:0:14273:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ebc40ca8000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1789478553.317405:0:14273:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb03fed180 x1876403964497536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789478553.317436:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964496896:0@lo:38:kworker.0 00000100:00100000:0.0:1789478553.317488:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478553.317532:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876403964497024:0@lo:38:kworker.0 00000100:00100000:0.0:1789478553.317551:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478553.317570:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876403964497152:0@lo:38:kworker.0 00000100:00100000:0.0:1789478553.317584:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478553.317616:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876403964497536:0@lo:38:kworker.0 00000100:00100000:0.0:1789478553.317633:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478553.317682:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964497280:0@lo:400:kworker.0 00000100:00100000:0.0:1789478553.317720:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478553.317739:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789478553.317745:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964497408:0@lo:400:kworker.0 00000100:00100000:0.0:1789478553.317780:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478553.317825:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964497024 00000100:00100000:0.0:1789478553.317832:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964497024 00000100:00100000:0.0:1789478553.317874:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964497152 00000100:00100000:0.0:1789478553.317877:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964497152 00000100:00100000:0.0:1789478553.317886:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964497536 00000100:00100000:0.0:1789478553.317888:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964497536 00000100:00100000:1.0:1789478553.317947:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964497280 00000100:00100000:3.0:1789478553.317949:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb044b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964496768:0@lo:400:kworker.0 00000100:00100000:1.0:1789478553.317951:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964497280 00000400:00000100:3.0:1789478553.317974:0:3646:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876403964496768 offset 0 length 224: 4 00000100:00100000:3.0:1789478553.317992:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964497792:0@lo:400:kworker.0 00000100:00100000:1.0:1789478553.318009:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1789478553.318011:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478553.318018:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964497280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478553.318028:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789478553.318033:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03feed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876403964497664:0@lo:400:kworker.0 00000100:00100000:3.0:1789478553.318064:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478553.318065:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964497280:12345-0@lo:400:kworker.0 Request processed in 49us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478553.318083:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1789478553.318085:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964496896 00000100:00100000:3.0:1789478553.318087:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964496896 00000100:00100000:1.0:1789478553.318096:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964497664 00000100:00100000:1.0:1789478553.318099:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964497664 00000100:00100000:3.0:1789478553.318113:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789478553.318113:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789478553.318117:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876403964496896:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1789478553.318118:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876403964497664:12345-0@lo:400:kworker.0 00010000:00020000:3.0:1789478553.318145:0:6522:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789478553.318160:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876403964497664:12345-0@lo:400:kworker.0 Request processed in 42us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478553.318166:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789478553.318173:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876403964496896:12345-0@lo:38:kworker.0 Request processed in 55us (685us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789478553.318178:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789478553.318179:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789478553.318182:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876403964497024:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789478553.318191:0:6518:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1789478553.318193:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789478553.318212:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876403964497024:12345-0@lo:38:kworker.0 Request processed in 29us (660us total) trans 0 rc -19/-19 00010000:00080000:3.0:1789478553.318215:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8ebb03feed80 x1876403964497664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478553.318218:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789478553.318227:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03feed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876403964497664:0@lo:400:kworker.0 00000100:00100000:1.0:1789478553.318229:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789478553.318233:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03feca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876403964497152:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789478553.318241:0:6518:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789478553.318262:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03feca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876403964497152:12345-0@lo:38:kworker.0 Request processed in 27us (676us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789478553.318268:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789478553.318279:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789478553.318282:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876403964497536:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789478553.318290:0:6518:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789478553.318313:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876403964497536:12345-0@lo:38:kworker.0 Request processed in 29us (679us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789478553.318324:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789478553.318357:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964497408 00000100:00100000:1.0:1789478553.318361:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964497408 00000100:00100000:1.0:1789478553.318402:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964497792 00000100:00100000:1.0:1789478553.318406:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964497792 00000100:00100000:1.0:1789478553.318424:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789478553.318430:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964497408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478553.318462:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964497408:12345-0@lo:400:kworker.0 Request processed in 32us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478553.318468:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789478553.318478:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789478553.318491:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964497792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478553.318518:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964497792:12345-0@lo:400:kworker.0 Request processed in 28us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478553.318523:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789478553.318560:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964497408:0@lo:400:kworker.0 00010000:00080000:1.0:1789478553.318571:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8ebb03fedc00 x1876403964497280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478553.318580:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964497280:0@lo:400:kworker.0 00000100:00080000:1.0:1789478553.318629:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc3bd0f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789478553.318634:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789478553.318637:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964496896:0@lo:38:kworker.0 00000100:00080000:1.0:1789478553.318645:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc3bcdf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789478553.318648:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789478553.318663:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876403964497024:0@lo:38:kworker.0 00000100:00080000:1.0:1789478553.318674:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc091ab000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789478553.318677:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789478553.318680:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876403964497152:0@lo:38:kworker.0 00000100:00080000:1.0:1789478553.318688:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc40ca8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789478553.318691:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789478553.318693:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876403964497536:0@lo:38:kworker.0 00000100:00080000:3.0:1789478553.318855:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789478553.318859:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789478553.318878:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964497792:0@lo:400:kworker.0 00000020:01000004:0.0:1789478553.751405:0:15449:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1789478553.772048:0:15449:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1789478553.772097:0:15449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf800/0x8ebaae74e8215e13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478553.772111:0:15449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf800/0x8ebaae74e8215e13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215e1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478553.772119:0:15449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf800/0x8ebaae74e8215e13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8215e1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478553.772137:0:15449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf800/0x8ebaae74e8215e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8215e1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478553.772196:0:15449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789478553.772202:0:15449:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789478553.772254:0:15449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789478553.772258:0:15449:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789478553.772264:0:15449:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789478553.772270:0:15449:0:(import.c:65:import_set_state_nolock()) ffff8ebc3bcdf000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789478553.772275:0:15449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789478553.772276:0:15449:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789478553.772279:0:15449:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789478553.773536:0:15449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66200/0x8ebaae74e8215e21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e28 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478553.773550:0:15449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66200/0x8ebaae74e8215e21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215e28 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478553.773557:0:15449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66200/0x8ebaae74e8215e21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8215e28 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478553.773564:0:15449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66200/0x8ebaae74e8215e21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8215e28 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478553.773645:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789478553.773653:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf800/0x8ebaae74e8215e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8215e1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478553.773661:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcf800 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:1.0:1789478553.773665:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf800/0x8ebaae74e8215e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8215e1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478553.773674:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf800/0x8ebaae74e8215e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ebaae74e8215e1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478553.773682:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf800/0x8ebaae74e8215e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ebaae74e8215e1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478553.773687:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789478553.773690:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789478553.773692:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789478553.773725:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf800/0x8ebaae74e8215e13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e8215e1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478553.773732:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789478553.773782:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf800/0x8ebaae74e8215e13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e8215e1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478553.773789:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf800/0x8ebaae74e8215e13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e8215e1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478553.773801:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789478553.773805:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66200/0x8ebaae74e8215e21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8215e28 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478553.773810:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b66200 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:1.0:1789478553.773813:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66200/0x8ebaae74e8215e21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8215e28 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478553.773819:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66200/0x8ebaae74e8215e21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ebaae74e8215e28 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478553.773824:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66200/0x8ebaae74e8215e21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ebaae74e8215e28 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478553.773830:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789478553.773832:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1789478553.773843:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66200/0x8ebaae74e8215e21 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e8215e28 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478553.774025:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789478553.774034:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66200/0x8ebaae74e8215e21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e8215e28 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478553.774042:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478553.774044:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478553.774052:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478553.774072:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964498048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789478553.774145:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478553.774198:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789478553.774204:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964497920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789478553.774226:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478553.774290:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964498048 00000100:00100000:1.0:1789478553.774296:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964498048 00000100:00100000:1.0:1789478553.774335:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964497920 00000100:00100000:1.0:1789478553.774339:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964497920 00000100:00100000:1.0:1789478553.774364:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789478553.774372:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08340c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1876403964498048:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789478553.774379:0:6502:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789478553 with bad export cookie 10284724516187887827 00000100:00100000:0.0:1789478553.775746:0:10392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789478553.775757:0:10392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3648:x1876403964497920:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789478553.775837:0:10392:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789478553 with bad export cookie 10284724516187887827 00000100:00100000:0.0:1789478553.775989:0:10392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3648:x1876403964497920:12345-0@lo:103:ldlm_bl.0 Request processed in 231us (1760us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789478553.775996:0:10392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1789478553.776118:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.111@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789478553.776133:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8ebc187da800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789478553.776136:0:3648:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1789478553.776754:0:15449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789478553.776946:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478553.776982:0:15449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66200/0x8ebaae74e8215e21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e8215e28 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478553.777082:0:15449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66c00/0x8ebaae74e8215ced lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215cf4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478553.777091:0:15449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66c00/0x8ebaae74e8215ced lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215cf4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478553.777098:0:15449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66c00/0x8ebaae74e8215ced lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8215cf4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478553.777119:0:15449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66c00/0x8ebaae74e8215ced lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8215cf4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478553.777187:0:15449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789478553.777195:0:15449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216089 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216090 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478553.777202:0:15449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216089 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8216090 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478553.777208:0:15449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216089 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8216090 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478553.777215:0:15449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216089 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8216090 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478553.781589:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789478553.781618:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66c00/0x8ebaae74e8215ced lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8215cf4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478553.781660:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b66c00 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478553.781664:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66c00/0x8ebaae74e8215ced lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8215cf4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478553.781673:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66c00/0x8ebaae74e8215ced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ebaae74e8215cf4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478553.781679:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66c00/0x8ebaae74e8215ced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ebaae74e8215cf4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478553.781684:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789478553.781687:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789478553.781691:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789478553.783714:0:15449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789478553.783734:0:15449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec800/0x8ebaae74e82159d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82159dd expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478553.783745:0:15449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec800/0x8ebaae74e82159d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e82159dd expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478553.783756:0:15449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec800/0x8ebaae74e82159d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e82159dd expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478553.783832:0:15449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec800/0x8ebaae74e82159d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e82159dd expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478553.783871:0:15449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789478553.783875:0:15449:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1789478553.783887:0:15449:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1789478553.783920:0:15449:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1789478553.783924:0:15449:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1789478553.783928:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789478553.783933:0:15449:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1789478553.783939:0:15449:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8ebc3f6c0800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789478553.783945:0:15449:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8ebc35e72800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789478553.783950:0:15449:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8ebc065899b8) has exports, disconnecting them 00000020:00080000:3.0:1789478553.783955:0:15449:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8ebc3f6c0800), last request at 1789478553 00000020:00000080:3.0:1789478553.783961:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215cb5 00000100:00080000:3.0:1789478553.783978:0:15449:0:(import.c:65:import_set_state_nolock()) ffff8ebc3f6c4800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789478553.784098:0:15449:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ebc3f6c0800): rc 0 00000020:00000080:3.0:1789478553.784102:0:15449:0:(genops.c:885:class_export_put()) final put ffff8ebc3f6c0800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1789478553.784114:0:15449:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8ebc35e72800), last request at 1789478553 00000020:00000080:3.0:1789478553.784118:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215b8f 00000100:00080000:3.0:1789478553.784138:0:15449:0:(import.c:65:import_set_state_nolock()) ffff8ebc35e77800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789478553.784148:0:15449:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ebc35e72800): rc 0 00000020:00000080:3.0:1789478553.784159:0:15449:0:(genops.c:885:class_export_put()) final put ffff8ebc35e72800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1789478553.784168:0:15449:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffff9dd900d87ae0 00000100:00080000:3.0:1789478553.784184:0:15449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789478553.784194:0:15449:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8ebb03ffe680 x1876403964494848/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789478564 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478553.784205:0:15449:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1789478553.785974:0:15449:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789478553.785983:0:15449:0:(import.c:65:import_set_state_nolock()) ffff8ebc3bd0f000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789478553.786239:0:15449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789478553.786694:0:15449:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1789478553.786714:0:15449:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789478553.786773:0:15449:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789478553.786795:0:15449:0:(import.c:65:import_set_state_nolock()) ffff8ebc34fac000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789478553.786817:0:15449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789478553.786819:0:15449:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1789478553.786826:0:15449:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789478553.786930:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:0:1876403964498304:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789478553.786964:0:15449:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789478553.786973:0:15449:0:(import.c:65:import_set_state_nolock()) ffff8ebc3c8a8000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789478553.786994:0:15449:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8ebc065899b8) has no exports 00000100:00100000:3.0:1789478553.787861:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964498176:0@lo:9:umount.0 00000100:00100000:3.0:1789478553.787923:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478553.787952:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964498432:0@lo:9:umount.0 00000100:00100000:3.0:1789478553.787972:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789478553.788008:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789478553.788015:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216089 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8216090 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478553.788025:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fde00 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:3.0:1789478553.788029:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216089 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8216090 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478553.788495:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216089 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ebaae74e8216090 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789478553.788507:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216089 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ebaae74e8216090 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478553.788525:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789478553.788527:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789478553.788530:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:2.0:1789478553.797064:0:3648:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.111@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789478553.797070:0:3648:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789478553.797079:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ebb044b6a00 x1876403964496768/t0(0) o400->MGC192.168.206.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789478569 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478553.797104:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ebb037e4e00 x1876403964498048/t0(0) o103->MGC192.168.206.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789478569 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478553.797114:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ebb037e7100 x1876403964497920/t0(0) o103->MGC192.168.206.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789478569 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789478553.797136:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789478553.797139:0:3648:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789478553.797141:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:0.0:1789478553.797801:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00000080:0.0:1789478553.797827:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc3f6c0800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1789478553.797876:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc35e72800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1789478553.797898:0:14273:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc3f6c4800 for lustre-MDT0001 00000020:00000080:0.0:1789478553.797903:0:14273:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc35e77800 for lustre-MDT0001 00010000:00010000:0.0:1789478553.798163:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66c00/0x8ebaae74e8215ced lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e8215cf4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478553.798173:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478553.798193:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66c00/0x8ebaae74e8215ced lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e8215cf4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478553.798201:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc35b66c00/0x8ebaae74e8215ced lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e8215cf4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478553.798223:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789478553.798251:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c56e5039-4535-4d8a-bd01-962355b55f9c:0:1876403964498560:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789478553.798385:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478553.798387:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478553.798389:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478553.798498:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216089 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e8216090 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478553.798507:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789478553.798532:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216089 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e8216090 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478553.798540:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216089 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ebaae74e8216090 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478553.798551:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478553.798553:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478553.798555:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478553.798808:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb044b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c56e5039-4535-4d8a-bd01-962355b55f9c:3646:1876403964496768:0@lo:400:kworker.0 00000100:00080000:2.0:1789478553.798879:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8ebc187da800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789478553.798885:0:3648:0:(import.c:510:import_select_connection()) MGC192.168.206.111@tcp: connect to NID 0@lo last attempt 162 00000100:00080000:2.0:1789478553.798896:0:3648:0:(import.c:625:import_select_connection()) MGC192.168.206.111@tcp: import ffff8ebc187da800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1789478553.798916:0:3648:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebc34cb7b80 x1876403964498816/t0(0) o250->MGC192.168.206.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789478553.798949:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964498048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789478553.799113:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c56e5039-4535-4d8a-bd01-962355b55f9c:3644:1876403964498816:0@lo:250:ptlrpcd_00_03.0 00000100:00100000:2.0:1789478553.799342:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964494848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789478553.799491:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:3648:1876403964497920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789478553.799510:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789478553.799516:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c56e5039-4535-4d8a-bd01-962355b55f9c:0:1876403964498688:0@lo:103:ldlm_bl.0 00000400:00000100:2.0:1789478553.799899:0:3644:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876403964498816 offset 0 length 520: 4 00000100:00100000:0.0:1789478553.800668:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964498176 00000100:00100000:0.0:1789478553.800678:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964498176 00000100:00100000:0.0:1789478553.800735:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964498432 00000100:00100000:0.0:1789478553.800739:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964498432 00000100:00100000:0.0:1789478553.800854:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789478553.800865:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876403964498176:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789478553.800892:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215be3 00000100:00080000:0.0:1789478553.800901:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8ebc35e71800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789478553.800942:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1789478553.801101:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3644:x1876403964498176:12345-0@lo:9:umount.0 Request processed in 238us (13176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478553.801108:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789478553.801135:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789478553.801143:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876403964498432:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789478553.801155:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215d1e 00000100:00080000:0.0:1789478553.801160:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8ebc3f6c3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789478553.801182:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1789478553.801256:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3644:x1876403964498432:12345-0@lo:9:umount.0 Request processed in 113us (13282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478553.801275:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000400:00000100:1.0:1789478553.803873:0:6502:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1876403964498048 offset 224 length 224: 4 00000100:00100000:1.0:1789478553.803895:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08340c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1876403964498048:12345-0@lo:103:ldlm_bl.0 Request processed in 29521us (29749us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789478553.803906:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1789478553.804014:0:15450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478553.804023:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec800/0x8ebaae74e82159d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e82159dd expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478553.804033:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc421ec800 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:1.0:1789478553.804038:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec800/0x8ebaae74e82159d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e82159dd expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478553.804047:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec800/0x8ebaae74e82159d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ebaae74e82159dd expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478553.804055:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec800/0x8ebaae74e82159d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ebaae74e82159dd expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478553.804071:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789478553.804074:0:8447:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789478553.804077:0:8447:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1789478553.804092:0:8447:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ebc187da800 00010000:00010000:1.0:1789478553.804096:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec800/0x8ebaae74e82159d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8ebaae74e82159dd expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478553.804103:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc421ec800/0x8ebaae74e82159d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8ebaae74e82159dd expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478553.804120:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478553.804140:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478553.804143:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478553.804149:0:15450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478553.804151:0:15450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789478553.805693:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc34fac000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789478553.805711:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789478553.805713:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789478553.805718:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964498176:0@lo:9:umount.0 00000100:00080000:3.0:1789478553.805734:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc3c8a8000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789478553.805742:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789478553.805744:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789478553.805747:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964498432:0@lo:9:umount.0 00010000:00010000:2.0:1789478553.807820:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478553.807829:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789478553.824336:0:15449:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8ebc065899b8) has no exports 00000020:01000000:2.0:1789478553.881161:0:15449:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ebb03445d80 - data ffff8ebc31b30000/ffff8ebc40fca000 00000020:01000000:2.0:1789478553.881324:0:15449:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ebc34e998a0 - data ffff8ebc3197ca20/ffff8ebc34fd5400 00000001:00000004:2.0:1789478553.897948:0:15449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1789478553.948447:0:15449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789478553.948456:0:15449:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1789478553.948464:0:15449:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789478553.952083:0:15449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789478553.952091:0:15449:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1789478553.952109:0:15449:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789478553.952111:0:15449:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789478553.952954:0:8823:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789478553.952959:0:8823:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:2.0:1789478553.952972:0:8823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1789478553.954275:0:15449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789478553.954282:0:15449:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:1.0:1789478553.954302:0:15449:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789478553.954305:0:15449:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789478553.954651:0:9991:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789478553.954655:0:9991:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1789478553.954667:0:9991:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789478553.956733:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e82159f9 00000020:00000080:1.0:1789478553.956743:0:15449:0:(genops.c:885:class_export_put()) final put ffff8ebc3bd0b800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789478553.957163:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc3bd0b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789478553.959980:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215a0e 00000020:00000080:1.0:1789478553.959991:0:15449:0:(genops.c:885:class_export_put()) final put ffff8ebc3bd0e000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789478553.960216:0:15449:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1789478553.960221:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789478553.960229:0:15449:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789478553.960233:0:15449:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8ebc06588000) has no exports 00000004:01000000:1.0:1789478553.960397:0:15449:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789478553.960405:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215d17 00000020:00000080:1.0:1789478553.960409:0:15449:0:(genops.c:885:class_export_put()) final put ffff8ebc3c8ab800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789478553.961378:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc3bd0e000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1789478553.964371:0:15449:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1789478553.964382:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789478553.964395:0:15449:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789478553.964400:0:15449:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8ebc40f719b8) has no exports 00000020:00000080:1.0:1789478553.964408:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215d10 00000020:00000080:1.0:1789478553.964415:0:15449:0:(genops.c:885:class_export_put()) final put ffff8ebc3c8ad000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789478553.964447:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc3c8ab800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789478553.964459:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc3c8ad000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1789478553.966131:0:15449:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1789478553.966137:0:15449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789478553.966140:0:15449:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1789478553.966146:0:15449:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789478553.966148:0:15449:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789478553.966187:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789478553.966197:0:15449:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789478553.966204:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215bd5 00000020:00000080:1.0:1789478553.966211:0:15449:0:(genops.c:885:class_export_put()) final put ffff8ebc34fae000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789478553.966216:0:15449:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1789478553.966221:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789478553.966225:0:15449:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789478553.966228:0:15449:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8ebb0229b370) has no exports 00000020:00000080:1.0:1789478553.966233:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215bce 00000020:00000080:0.0:1789478553.966374:0:14273:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc3c8a8000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789478553.966383:0:14273:0:(genops.c:885:class_export_put()) final put ffff8ebc3f689000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789478553.966386:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc3f689000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1789478553.966391:0:14273:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789478553.966466:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc34fae000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789478553.966711:0:15449:0:(genops.c:885:class_export_put()) final put ffff8ebc34fab800/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1789478553.967241:0:15449:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1789478553.967245:0:15449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789478553.967249:0:15449:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:1.0:1789478553.967259:0:15449:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789478553.967972:0:15449:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789478553.968097:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc34fab800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789478553.969150:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789478553.969163:0:15449:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1789478553.969176:0:15449:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789478553.969183:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215a4d 00000020:00000080:1.0:1789478553.969191:0:15449:0:(genops.c:885:class_export_put()) final put ffff8ebc359be000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789478553.969197:0:15449:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1789478553.969213:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789478553.969218:0:15449:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789478553.969221:0:15449:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8ebc34c73370) has no exports 00000020:00000080:1.0:1789478553.969230:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215a38 00000020:00000080:1.0:1789478553.969234:0:15449:0:(genops.c:885:class_export_put()) final put ffff8ebc3bd0d000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789478553.969715:0:14273:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc34fac000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789478553.969723:0:14273:0:(genops.c:885:class_export_put()) final put ffff8ebc34fae800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789478553.969726:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc34fae800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1789478553.969732:0:14273:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789478553.969815:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc359be000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789478553.969820:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc3bd0d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789478553.972782:0:15449:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789478553.972790:0:15449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789478553.972805:0:15449:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789478553.972814:0:15449:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789478553.972926:0:14273:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc3bd0f000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789478553.972981:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789478553.972992:0:15449:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789478553.972997:0:15449:0:(genops.c:885:class_export_put()) final put ffff8ebc34c95000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789478553.973001:0:15449:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc34c95000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1789478553.973007:0:15449:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789478553.973189:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789478553.973194:0:15449:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789478553.973197:0:15449:0:(genops.c:885:class_export_put()) final put ffff8ebc3bcdd000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789478553.973199:0:15449:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc3bcdd000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789478553.973212:0:15449:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789478553.973396:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215a15 00000020:00000080:0.0:1789478553.973403:0:15449:0:(genops.c:885:class_export_put()) final put ffff8ebc3bd0a000/lustre-MDD0001_UUID 00000020:01000000:0.0:1789478553.973453:0:15449:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789478553.973458:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789478553.973463:0:15449:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789478553.973467:0:15449:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8ebc3bd13370) has no exports 00000020:00000080:0.0:1789478553.973487:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789478553.973491:0:15449:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789478553.973494:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215a1c 00000020:00000080:0.0:1789478553.973498:0:15449:0:(genops.c:885:class_export_put()) final put ffff8ebc3bd0c800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789478553.973761:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc3bd0a000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1789478553.973766:0:14273:0:(genops.c:885:class_export_put()) final put ffff8ebc3bd08000/lustre-MDD0001_UUID 00000020:00000080:2.0:1789478553.973768:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc3bd08000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1789478553.973776:0:14273:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:01000004:0.0:1789478553.974159:0:15449:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ebc34d64800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789478553.974164:0:15449:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ebc34d64800 2 00000020:01000004:0.0:1789478553.974167:0:15449:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ebc34d64800 from lustre-MDT0001 00000020:00000080:0.0:1789478553.974190:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789478553.974195:0:15449:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789478553.974198:0:15449:0:(genops.c:885:class_export_put()) final put ffff8ebc3bd0c000/lustre-MDT0001_UUID 00000020:00000080:0.0:1789478553.974200:0:15449:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc3bd0c000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789478553.974207:0:15449:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789478553.974239:0:15449:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789478553.974242:0:15449:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789478553.974246:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789478553.974249:0:15449:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789478553.974255:0:15449:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8ebc40caf000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789478553.974260:0:15449:0:(genops.c:1553:class_disconnect_exports()) OBD device 15 (ffff8ebc3bd14d28) has exports, disconnecting them 00000020:00080000:0.0:1789478553.974264:0:15449:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8ebc40caf000), last request at 1789478348 00000020:00000080:0.0:1789478553.974268:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215aaf 00000020:00080000:0.0:1789478553.974283:0:15449:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ebc40caf000): rc 0 00000020:00000080:0.0:1789478553.974286:0:15449:0:(genops.c:885:class_export_put()) final put ffff8ebc40caf000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1789478553.974937:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc3bd0c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789478553.974946:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc40caf000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1789478553.989054:0:15449:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1789478553.989062:0:15449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789478553.989075:0:15449:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789478553.989081:0:15449:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789478553.989363:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789478553.989372:0:15449:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1789478553.989379:0:15449:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ebc34d64800 1 00000020:00000080:0.0:1789478553.989385:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e82159ac 00000020:00000080:0.0:1789478553.989393:0:15449:0:(genops.c:885:class_export_put()) final put ffff8ebc34d63800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789478553.989416:0:14273:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc3bcdf000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1789478553.989424:0:14273:0:(genops.c:885:class_export_put()) final put ffff8ebc359bb800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1789478553.989427:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc359bb800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1789478553.989438:0:14273:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:0.0:1789478553.989557:0:15449:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1789478553.989561:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789478553.989566:0:15449:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789478553.989570:0:15449:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8ebc0658cd28) has no exports 00000020:00000080:2.0:1789478553.993967:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc34d63800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789478554.051688:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789478554.051701:0:15449:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1789478554.051707:0:15449:0:(genops.c:885:class_export_put()) final put ffff8ebc34d65800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789478554.051711:0:15449:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc34d65800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1789478554.051719:0:15449:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1789478554.051840:0:15449:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ebc34d61800 00000020:01000000:1.0:1789478554.051858:0:15449:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1789478554.051863:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789478554.051867:0:15449:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789478554.051870:0:15449:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8ebc08d94d28) has no exports 00000100:00100000:1.0:1789478554.051959:0:13638:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8ebc34ea9400:13638] 4 exiting: rc = 0 00000100:00100000:0.0:1789478554.051985:0:10096:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8ebb034d3c00:10096] 3 exiting: rc = 0 00000100:00100000:0.0:1789478554.052099:0:6519:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8ebc21807600:6519] 2 exiting: rc = 0 00000100:00100000:2.0:1789478554.052350:0:6518:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8ebc1a3ac000:6518] 1 exiting: rc = 0 00000100:00100000:3.0:1789478554.052365:0:6517:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8ebc1a32a400:6517] 0 exiting: rc = 1 00000100:00100000:0.0:1789478554.052509:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.052517:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.052523:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.052529:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.052535:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.052544:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.052550:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.052556:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.052561:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.052568:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.052573:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.052578:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.052584:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053135:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053142:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053148:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053153:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053159:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053164:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053171:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053176:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053195:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053201:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053207:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053212:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053218:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053223:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053229:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053234:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053240:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053246:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053253:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053259:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053265:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053271:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053276:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053281:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053286:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053291:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053296:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053301:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053306:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053312:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053317:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053323:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053329:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053335:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053340:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053346:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053351:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053357:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053362:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053367:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053373:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053378:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053383:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053397:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053403:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053408:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053414:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053420:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053426:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053431:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.053437:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.062485:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8ebc1018a200:6521] 1 exiting: rc = 0 00000100:00100000:3.0:1789478554.062807:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8ebc08364000:6520] 0 exiting: rc = 1 00000100:00100000:1.0:1789478554.062938:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.062945:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.062950:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.062956:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.062961:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.062965:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.062971:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.062976:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.062981:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.062994:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063001:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063007:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063013:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063019:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063024:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063029:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063045:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063050:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063059:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063066:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063073:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063078:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063083:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063087:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063092:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063100:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063105:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063110:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063114:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063118:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063132:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063137:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063141:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063145:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063149:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063154:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063158:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063165:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063170:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063174:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063178:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063182:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063187:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063191:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063195:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063199:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063204:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063208:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063213:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063218:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063223:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063236:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063240:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063251:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063256:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063262:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063268:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063273:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063278:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063283:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063289:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063294:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063300:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.063305:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789478554.064065:0:7991:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8ebc40e1de00:7991] 2 exiting: rc = 0 00000100:00100000:3.0:1789478554.064449:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8ebc0a6fec00:6522] 0 exiting: rc = 1 00000100:00100000:3.0:1789478554.064521:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8ebc0a6fe800:6523] 1 exiting: rc = 0 00000100:00100000:1.0:1789478554.064911:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.064930:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.064937:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.064943:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.064955:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.064963:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.064969:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.064975:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.064981:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.064987:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065080:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065088:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065094:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065099:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065105:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065110:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065141:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065148:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065153:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065159:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065165:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065170:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065186:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065192:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065197:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065204:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065209:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065216:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065237:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065244:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065250:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065256:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065261:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065267:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065272:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065279:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065284:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065290:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065295:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065301:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065383:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065391:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065398:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065409:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065415:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065423:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065428:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065434:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065441:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065446:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065452:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065458:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065474:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065483:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065488:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065493:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065498:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065508:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065514:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065519:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065525:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065532:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065537:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.065543:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478554.076145:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8ebc08db1400:6524] 0 exiting: rc = 1 00000100:00100000:1.0:1789478554.076254:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8ebc08db0a00:6525] 1 exiting: rc = 0 00000100:00100000:0.0:1789478554.076371:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076378:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076384:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076388:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076393:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076398:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076404:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076409:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076413:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076418:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076423:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076428:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076434:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076439:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076444:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076448:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076453:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076458:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076463:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076468:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076474:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076480:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076485:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076489:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076493:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076497:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076502:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076523:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076528:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076533:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076539:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076543:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076548:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076554:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076559:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076565:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076570:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076575:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076581:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076892:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076901:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076905:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076911:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076915:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.076920:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.077062:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.077068:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.077073:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.077078:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.077083:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.077089:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.077094:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.077099:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.077104:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.077109:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.077115:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.077130:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.077136:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.077141:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.077147:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.077152:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.077156:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.077172:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.077178:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478554.077957:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8ebc08db0200:6526] 0 exiting: rc = 1 00000100:00100000:2.0:1789478554.078195:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8ebc08db0600:6527] 1 exiting: rc = 0 00000100:00100000:0.0:1789478554.078418:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078424:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078430:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078436:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078441:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078446:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078451:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078456:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078461:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078466:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078472:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078477:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078482:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078487:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078493:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078497:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078502:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078507:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078512:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078517:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078523:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078527:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078532:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078536:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078542:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078546:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078551:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078556:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078561:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078566:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078570:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078575:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.078580:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079235:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079240:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079244:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079249:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079254:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079260:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079265:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079270:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079275:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079281:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079286:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079291:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079296:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079301:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079306:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079312:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079317:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079321:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079326:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079331:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079336:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079341:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079346:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079351:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079356:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079361:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079366:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079371:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079376:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079381:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.079387:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478554.080198:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8ebc08db0000:6529] 1 exiting: rc = 0 00000100:00100000:1.0:1789478554.080571:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8ebc08db1600:6528] 0 exiting: rc = 1 00000100:00100000:0.0:1789478554.080703:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.080709:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.080713:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.080718:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.080732:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.080737:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.080743:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.080759:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.080764:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.080932:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.080941:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.080946:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.080952:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.080957:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.080963:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.080968:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.080973:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.080978:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.080983:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.080988:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081111:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081116:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081132:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081138:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081143:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081149:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081155:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081160:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081165:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081170:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081176:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081181:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081186:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081191:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081197:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081202:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081209:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081215:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081220:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081234:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081238:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081243:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081248:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081254:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081259:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081264:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081270:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081275:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081280:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081286:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081291:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081297:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081303:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081308:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081313:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081319:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081324:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081329:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081334:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081339:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081345:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081349:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081354:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.081359:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.082196:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8ebc08db0400:6531] 1 exiting: rc = 0 00000100:00100000:0.0:1789478554.082376:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8ebc08db1000:6532] 2 exiting: rc = 0 00000100:00100000:2.0:1789478554.082617:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8ebc08db0800:6530] 0 exiting: rc = 1 00000100:00100000:0.0:1789478554.082910:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.082917:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.082954:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.082962:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.082968:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.082973:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.082978:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.082984:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083076:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083081:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083087:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083092:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083097:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083101:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083106:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083111:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083116:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083129:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083134:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083140:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083145:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083150:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083155:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083160:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083165:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083170:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083188:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083194:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083199:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083204:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083210:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083216:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083222:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083227:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083233:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083238:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083244:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083249:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083255:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083261:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083267:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083273:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083279:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083292:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083298:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083304:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083309:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083315:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083320:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083326:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083464:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083471:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083477:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083484:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083490:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083495:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083500:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083506:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083511:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083517:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083522:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083528:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083533:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478554.083543:0:15449:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789478554.089255:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789478554.089265:0:15449:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789478554.089270:0:15449:0:(genops.c:885:class_export_put()) final put ffff8ebc0501a800/MDS_uuid 00000020:00000080:0.0:1789478554.089274:0:15449:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc0501a800/MDS_uuid for MDS 00000020:01000000:0.0:1789478554.089280:0:15449:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789478554.089407:0:15449:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1789478554.149707:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478555.174832:0:15450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478556.200479:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478557.220688:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789478557.497526:0:15651:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1789478557.514072:0:15651:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789478557.514133:0:15651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215df7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215dfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478557.514148:0:15651:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215df7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215dfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478557.514155:0:15651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215df7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8215dfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478557.514161:0:15651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8215dfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478557.514185:0:15651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789478557.514199:0:15651:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789478557.514220:0:15651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789478557.514224:0:15651:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789478557.514229:0:15651:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789478557.514235:0:15651:0:(import.c:65:import_set_state_nolock()) ffff8ebc091ab000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789478557.514240:0:15651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789478557.514255:0:15651:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789478557.514258:0:15651:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789478557.515302:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789478557.515312:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8215dfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478557.515324:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc00030c00 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478557.515328:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8215dfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478557.515356:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215df7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ebaae74e8215dfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478557.515364:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215df7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ebaae74e8215dfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478557.515370:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789478557.515373:0:8447:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789478557.515376:0:8447:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789478557.515390:0:8447:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ebc187da800 00010000:00010000:0.0:1789478557.515405:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215df7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x8ebaae74e8215dfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478557.515413:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc00030c00/0x8ebaae74e8215df7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x8ebaae74e8215dfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478557.515429:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478557.515431:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478557.515433:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789478557.515895:0:15651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789478557.515900:0:15651:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789478557.515906:0:15651:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789478557.515928:0:15651:0:(import.c:65:import_set_state_nolock()) ffff8ebc35e73000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789478557.516020:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876403964498944:0@lo:39:umount.0 00000400:00000100:0.0:1789478557.516069:0:3644:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876403964498944 offset 0 length 224: 4 00010000:00010000:1.0:1789478558.245004:0:15450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789478558.439156:0:14273:0:(pinger.c:229:ptlrpc_pinger_process_import()) c56e5039-4535-4d8a-bd01-962355b55f9c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789478558.439165:0:14273:0:(pinger.c:247:ptlrpc_pinger_process_import()) c56e5039-4535-4d8a-bd01-962355b55f9c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789478558.439168:0:14273:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789478558.439171:0:14273:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789478558.439175:0:14273:0:(import.c:65:import_set_state_nolock()) ffff8ebc40ca8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789478558.439182:0:14273:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 382 00000100:00080000:1.0:1789478558.439187:0:14273:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789478558.439199:0:14273:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ebc40ca8000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1789478558.439233:0:14273:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb037e7480 x1876403964499072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789478558.439387:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876403964499200:0@lo:400:kworker.0 00000400:00000100:2.0:1789478558.439432:0:3648:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876403964499200 offset 0 length 224: 4 00000100:00100000:0.0:1789478558.439579:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876403964499072:0@lo:38:kworker.0 00000400:00000100:0.0:1789478558.439621:0:3644:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876403964499072 offset 0 length 520: 4 00010000:00010000:2.0:1789478559.268749:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789478559.978241:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789478559.978250:0:8425:0:(genops.c:885:class_export_put()) final put ffff8ebc35e72000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789478559.978315:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc35e72000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789478559.978358:0:14273:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc35e71800 for lustre-OST0000 00000001:00100000:1.0:1789478559.978711:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789478559.978715:0:9510:0:(genops.c:885:class_export_put()) final put ffff8ebc3f6c4000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789478559.978899:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc3f6c4000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789478559.978940:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc3f6c3800 for lustre-OST0001 00010000:00010000:2.0:1789478560.292747:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478561.318101:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478562.341120:0:15450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478563.365270:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478563.556730:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789478553/real 1789478553] req@ffff8ebc34cb7b80 x1876403964498816/t0(0) o250->MGC192.168.206.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789478563 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478563.556764:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ebc34cb7b80 x1876403964498816/t0(0) o250->MGC192.168.206.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789478563 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789478563.556771:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c56e5039-4535-4d8a-bd01-962355b55f9c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789478563.556776:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) c56e5039-4535-4d8a-bd01-962355b55f9c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789478563.556779:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789478563.556788:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789478563.556808:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc187da800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789478563.556833:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00080000:2.0:1789478563.556836:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c56e5039-4535-4d8a-bd01-962355b55f9c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1789478563.556837:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789478563.556839:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c56e5039-4535-4d8a-bd01-962355b55f9c:3644:1876403964498816:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1789478563.556841:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1789478563.556846:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ebc187da800 MGS: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1789478563.556852:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876403964499328:0@lo:400:kworker.0 00000400:00000100:3.0:1789478563.556976:0:3646:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876403964499328 offset 0 length 224: 4 00000100:00080000:2.0:1789478563.563005:0:36:0:(import.c:510:import_select_connection()) MGC192.168.206.111@tcp: connect to NID 0@lo last attempt 382 00000100:00080000:2.0:1789478563.563013:0:36:0:(import.c:589:import_select_connection()) MGC192.168.206.111@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789478563.563026:0:36:0:(import.c:625:import_select_connection()) MGC192.168.206.111@tcp: import ffff8ebc187da800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1789478563.563062:0:36:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebc34cb7100 x1876403964499456/t0(0) o250->MGC192.168.206.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789478563.563110:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789478563.563114:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789478563.564308:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c56e5039-4535-4d8a-bd01-962355b55f9c:3644:1876403964499456:0@lo:250:kworker.0 00000400:00000100:0.0:1789478563.564354:0:3644:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876403964499456 offset 0 length 520: 4 00010000:00010000:2.0:1789478564.392742:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478565.412946:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478566.437636:0:15450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478567.463012:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478567.652722:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789478557/real 1789478557] req@ffff8ebc34cb4700 x1876403964498944/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789478567 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478567.652757:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ebc34cb4700 x1876403964498944/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789478567 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789478567.652774:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc35e73000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789478567.652793:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876403964498944:0@lo:39:umount.0 00000100:00080000:2.0:1789478567.652893:0:15651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789478567.652898:0:15651:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789478567.652902:0:15651:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789478567.658978:0:15651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215e05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215e0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478567.658997:0:15651:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215e05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215e0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478567.659005:0:15651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215e05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8215e0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478567.659011:0:15651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215e05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8215e0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478567.659102:0:15651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789478567.659110:0:15651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc600/0x8ebaae74e821607b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216082 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478567.659117:0:15651:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc600/0x8ebaae74e821607b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8216082 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478567.659124:0:15651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc600/0x8ebaae74e821607b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8216082 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478567.659146:0:15651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc600/0x8ebaae74e821607b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8216082 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478567.659227:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789478567.659243:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215e05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8215e0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478567.659250:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc00030000 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478567.659254:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215e05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8215e0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478567.659262:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215e05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ebaae74e8215e0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478567.659270:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215e05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ebaae74e8215e0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478567.659287:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789478567.659290:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1789478567.659301:0:6506:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ebc187da800 00010000:00010000:0.0:1789478567.659305:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215e05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x8ebaae74e8215e0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478567.659313:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc00030000/0x8ebaae74e8215e05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x8ebaae74e8215e0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478567.659329:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789478567.659333:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc600/0x8ebaae74e821607b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8216082 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478567.659339:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fc600 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478567.659353:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc600/0x8ebaae74e821607b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8216082 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478567.659361:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc600/0x8ebaae74e821607b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ebaae74e8216082 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478567.659368:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc600/0x8ebaae74e821607b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ebaae74e8216082 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478567.659374:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789478567.659377:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1789478567.659381:0:6506:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ebc187da800 00010000:00010000:0.0:1789478567.659383:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc600/0x8ebaae74e821607b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8ebaae74e8216082 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478567.659399:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478567.659401:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478567.659403:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478567.659582:0:15651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789478567.659588:0:15651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc600/0x8ebaae74e821607b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8ebaae74e8216082 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478567.659617:0:15651:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1789478567.659623:0:15651:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1789478567.659626:0:15651:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789478567.659654:0:15651:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789478567.659657:0:15651:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789478567.659662:0:15651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789478567.659669:0:15651:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789478567.659674:0:15651:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8ebc091a0000) has no exports 00000020:00080000:2.0:1789478567.659695:0:15651:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8ebc091a0000) has no exports 00000020:01000000:2.0:1789478567.661349:0:15651:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ebb021fcf00 - data ffff8ebc31ab0870/ffff8ebb0324b800 00000020:01000000:2.0:1789478567.661502:0:15651:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ebb02464000 - data ffff8ebc31a416c0/ffff8ebb02424800 00010000:00010000:0.0:1789478567.662007:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789478567.675790:0:15651:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789478567.688949:0:15651:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215b49 00000020:00000080:2.0:1789478567.688959:0:15651:0:(genops.c:885:class_export_put()) final put ffff8ebb01b61800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789478567.689210:0:15651:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ebc40e0d800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789478567.689214:0:15651:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ebc40e0d800 2 00000020:01000004:2.0:1789478567.689217:0:15651:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ebc40e0d800 from lustre-OST0000 00000020:00000080:2.0:1789478567.689244:0:15651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789478567.689253:0:15651:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789478567.689256:0:15651:0:(genops.c:885:class_export_put()) final put ffff8ebb01b64800/lustre-OST0000_UUID 00000020:00000080:2.0:1789478567.689258:0:15651:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebb01b64800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789478567.689266:0:15651:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789478567.689330:0:15651:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789478567.689334:0:15651:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789478567.689337:0:15651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789478567.689342:0:15651:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789478567.689348:0:15651:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8ebb01bdc000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789478567.689354:0:15651:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8ebb022999b8) has exports, disconnecting them 00000020:00080000:2.0:1789478567.689358:0:15651:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8ebb01bdc000), last request at 1789478365 00000020:00000080:2.0:1789478567.689362:0:15651:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215b73 00000020:00080000:2.0:1789478567.689371:0:15651:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ebb01bdc000): rc 0 00000020:00000080:2.0:1789478567.689374:0:15651:0:(genops.c:885:class_export_put()) final put ffff8ebb01bdc000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789478567.689812:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebb01b61800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789478567.689823:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebb01bdc000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1789478567.691575:0:15651:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789478567.691582:0:15651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789478567.691586:0:15651:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789478567.691617:0:15651:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789478567.691794:0:15651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789478567.691802:0:15651:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1789478567.691807:0:15651:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789478567.691811:0:15651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789478567.691815:0:15651:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789478567.691822:0:15651:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8ebc40ca9000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789478567.691828:0:15651:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8ebc3bd10000) has exports, disconnecting them 00000020:00080000:1.0:1789478567.691832:0:15651:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8ebc40ca9000), last request at 1789478365 00000020:00000080:1.0:1789478567.691835:0:15651:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215b88 00000020:00080000:1.0:1789478567.691849:0:15651:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ebc40ca9000): rc 0 00000020:00000080:1.0:1789478567.691854:0:15651:0:(genops.c:885:class_export_put()) final put ffff8ebc40ca9000/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1789478567.692248:0:14273:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc091ab000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789478567.692257:0:14273:0:(genops.c:885:class_export_put()) final put ffff8ebb01b65000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1789478567.692260:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebb01b65000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1789478567.692271:0:14273:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1789478567.692346:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc40ca9000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1789478567.699681:0:15651:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789478567.699689:0:15651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789478567.699693:0:15651:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789478567.699707:0:15651:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789478567.699741:0:14273:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc35e73000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1789478567.699913:0:15651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789478567.699930:0:15651:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1789478567.699936:0:15651:0:(genops.c:885:class_export_put()) final put ffff8ebc35e76000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1789478567.699939:0:15651:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc35e76000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1789478567.699945:0:15651:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1789478567.700020:0:15651:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ebc40e0d800 1 00000020:00000080:2.0:1789478567.700026:0:15651:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215b11 00000020:00000080:2.0:1789478567.700032:0:15651:0:(genops.c:885:class_export_put()) final put ffff8ebc40ef4000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789478567.700059:0:15651:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789478567.700067:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc40ef4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789478567.700077:0:15651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789478567.700081:0:15651:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789478567.700085:0:15651:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8ebc27158000) has no exports 00000020:00000080:2.0:1789478567.731151:0:15651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789478567.731170:0:15651:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789478567.731179:0:15651:0:(genops.c:885:class_export_put()) final put ffff8ebc40e0b800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789478567.731183:0:15651:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc40e0b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789478567.731193:0:15651:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789478567.731305:0:15651:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ebc40e0b000 00000020:02000400:2.0:1789478567.731357:0:15651:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1789478568.484890:0:15450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789478568.688190:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c56e5039-4535-4d8a-bd01-962355b55f9c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789478568.688200:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) c56e5039-4535-4d8a-bd01-962355b55f9c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789478568.688212:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789478568.688216:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789478568.688357:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876403964499584:0@lo:400:kworker.0 00000400:00000100:3.0:1789478568.688409:0:3646:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876403964499584 offset 0 length 224: 4 00010000:00010000:2.0:1789478569.508680:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789478570.530108:0:15853:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00010000:00010000:1.0:1789478570.535374:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789478570.541101:0:15853:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789478570.541200:0:15853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76a00/0x8ebaae74e8215ddb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215de2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478570.541397:0:15853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76a00/0x8ebaae74e8215ddb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215de2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478570.541405:0:15853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76a00/0x8ebaae74e8215ddb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8215de2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478570.541413:0:15853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76a00/0x8ebaae74e8215ddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8215de2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478570.541451:0:15853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789478570.541458:0:15853:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789478570.541490:0:15853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789478570.541502:0:15853:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ebb037e7480 x1876403964499072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789478578 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478570.541516:0:15853:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00010000:00010000:0.0:1789478570.541516:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:1.0:1789478570.541524:0:15853:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1789478570.541526:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76a00/0x8ebaae74e8215ddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8215de2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789478570.541531:0:15853:0:(import.c:65:import_set_state_nolock()) ffff8ebc40ca8000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:0.0:1789478570.541538:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76a00 already unused, calling callback (ffffffffc1383c20) 00000100:00080000:1.0:1789478570.541540:0:15853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:00010000:0.0:1789478570.541544:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76a00/0x8ebaae74e8215ddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8215de2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478570.541546:0:15853:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ebb037e7480 x1876403964499072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789478578 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1789478570.541564:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76a00/0x8ebaae74e8215ddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ebaae74e8215de2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478570.541565:0:15853:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789478570.541570:0:15853:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 10000000:00010000:0.0:1789478570.541589:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76a00/0x8ebaae74e8215ddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ebaae74e8215de2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478570.541613:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789478570.541616:0:8447:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00100000:3.0:1789478570.541625:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876403964499072:0@lo:38:kworker.0 10000000:01000000:0.0:1789478570.541626:0:8447:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789478570.541642:0:8447:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ebc187da800 00010000:00010000:0.0:1789478570.541651:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76a00/0x8ebaae74e8215ddb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8ebaae74e8215de2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478570.541672:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76a00/0x8ebaae74e8215ddb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8ebaae74e8215de2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478570.541684:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478570.541686:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478570.541689:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789478570.542843:0:15853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789478570.542854:0:15853:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ebb037e5500 x1876403964499200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478574 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478570.542926:0:15853:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ebc34cb5880 x1876403964499328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478579 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478570.542948:0:15853:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ebb03fee680 x1876403964499584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478584 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478570.542955:0:15853:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789478570.542959:0:15853:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789478570.542978:0:15853:0:(import.c:65:import_set_state_nolock()) ffff8ebb027e4000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789478570.543018:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876403964499200:0@lo:400:kworker.0 00000100:00100000:2.0:1789478570.543058:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876403964499712:0@lo:39:umount.0 00000400:00000100:2.0:1789478570.543101:0:3644:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876403964499712 offset 0 length 224: 4 00000100:00100000:3.0:1789478570.543791:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876403964499584:0@lo:400:kworker.0 00000100:00100000:3.0:1789478570.543801:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876403964499328:0@lo:400:kworker.0 00010000:00010000:3.0:1789478571.556834:0:15450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478572.582307:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478573.604950:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789478573.797665:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c56e5039-4535-4d8a-bd01-962355b55f9c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789478573.797674:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) c56e5039-4535-4d8a-bd01-962355b55f9c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789478574.628985:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478575.652851:0:15450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478576.676736:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478577.704100:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478578.724855:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478578.725376:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789478563/real 1789478563] req@ffff8ebc34cb7100 x1876403964499456/t0(0) o250->MGC192.168.206.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789478578 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478578.725407:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ebc34cb7100 x1876403964499456/t0(0) o250->MGC192.168.206.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789478578 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789478578.725425:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc187da800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789478578.725452:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1789478578.725483:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c56e5039-4535-4d8a-bd01-962355b55f9c:3644:1876403964499456:0@lo:250:kworker.0 00000100:00080000:2.0:1789478578.725498:0:14273:0:(pinger.c:229:ptlrpc_pinger_process_import()) c56e5039-4535-4d8a-bd01-962355b55f9c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789478578.725505:0:14273:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1789478578.725507:0:14273:0:(import.c:65:import_set_state_nolock()) ffff8ebc187da800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789478578.725514:0:14273:0:(import.c:510:import_select_connection()) MGC192.168.206.111@tcp: connect to NID 0@lo last attempt 392 00000100:00080000:2.0:1789478578.725519:0:14273:0:(import.c:589:import_select_connection()) MGC192.168.206.111@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789478578.725530:0:14273:0:(import.c:625:import_select_connection()) MGC192.168.206.111@tcp: import ffff8ebc187da800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1789478578.725560:0:14273:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebc34cb6300 x1876403964499840/t0(0) o250->MGC192.168.206.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789478578.725651:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c56e5039-4535-4d8a-bd01-962355b55f9c:3644:1876403964499840:0@lo:250:kworker.0 00000400:00000100:3.0:1789478578.725689:0:3644:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876403964499840 offset 0 length 520: 4 00010000:00010000:3.0:1789478579.749528:0:15450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478580.772821:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789478570/real 1789478570] req@ffff8ebb037e6300 x1876403964499712/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789478580 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478580.772852:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ebb037e6300 x1876403964499712/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789478580 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789478580.772885:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebb027e4000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789478580.772905:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876403964499712:0@lo:39:umount.0 00010000:00010000:2.0:1789478580.772959:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789478580.773377:0:15853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789478580.773382:0:15853:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789478580.773387:0:15853:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789478580.774712:0:15853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce000/0x8ebaae74e8215de9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8215df0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478580.774728:0:15853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce000/0x8ebaae74e8215de9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8215df0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478580.774735:0:15853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce000/0x8ebaae74e8215de9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8215df0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478580.774741:0:15853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce000/0x8ebaae74e8215de9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8215df0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478580.774818:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789478580.774826:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce000/0x8ebaae74e8215de9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8215df0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478580.774835:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fce000 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478580.774839:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce000/0x8ebaae74e8215de9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8215df0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478580.774849:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce000/0x8ebaae74e8215de9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ebaae74e8215df0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478580.774856:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce000/0x8ebaae74e8215de9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ebaae74e8215df0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478580.774862:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789478580.774865:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1789478580.774887:0:6506:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ebc187da800 00010000:00010000:0.0:1789478580.774890:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce000/0x8ebaae74e8215de9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8ebaae74e8215df0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478580.774898:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478580.774900:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478580.774902:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478580.774923:0:15853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789478580.774930:0:15853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc40fce000/0x8ebaae74e8215de9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8ebaae74e8215df0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478580.774948:0:15853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67600/0x8ebaae74e821606d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216074 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478580.774954:0:15853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67600/0x8ebaae74e821606d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8216074 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478580.774960:0:15853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67600/0x8ebaae74e821606d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8216074 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478580.774967:0:15853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67600/0x8ebaae74e821606d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ebaae74e8216074 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478580.774999:0:15853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789478580.775004:0:15853:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1789478580.775009:0:15853:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:0.0:1789478580.775020:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789478580.775026:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67600/0x8ebaae74e821606d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8216074 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478580.775032:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67600 already unused, calling callback (ffffffffc1383c20) 00000020:01000004:1.0:1789478580.775036:0:15853:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 10000000:00010000:0.0:1789478580.775036:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67600/0x8ebaae74e821606d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ebaae74e8216074 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1789478580.775043:0:15853:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:0.0:1789478580.775048:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67600/0x8ebaae74e821606d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ebaae74e8216074 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789478580.775050:0:15853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789478580.775057:0:15853:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 10000000:00010000:0.0:1789478580.775058:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67600/0x8ebaae74e821606d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ebaae74e8216074 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789478580.775063:0:15853:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8ebc2715b370) has no exports 10000000:01000000:0.0:1789478580.775069:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789478580.775072:0:8447:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789478580.775074:0:8447:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789478580.775083:0:8447:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ebc187da800 00010000:00010000:0.0:1789478580.775086:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67600/0x8ebaae74e821606d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8ebaae74e8216074 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789478580.775090:0:15853:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8ebc2715b370) has no exports 00010000:00010000:0.0:1789478580.775095:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc35b67600/0x8ebaae74e821606d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8ebaae74e8216074 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478580.775122:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478580.775124:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478580.775125:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789478580.782405:0:15853:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ebb021fc180 - data ffff8ebc31b32510/ffff8ebb0324b000 00000020:01000000:1.0:1789478580.782518:0:15853:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ebc3bc9f720 - data ffff8ebb01c39798/ffff8ebb03338400 00100000:10000000:1.0:1789478580.791150:0:15853:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789478580.800735:0:15853:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215c6f 00000020:00000080:0.0:1789478580.800746:0:15853:0:(genops.c:885:class_export_put()) final put ffff8ebb027e6000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789478580.800756:0:15853:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ebc3f6c1800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789478580.800759:0:15853:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ebc3f6c1800 2 00000020:01000004:0.0:1789478580.800762:0:15853:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ebc3f6c1800 from lustre-OST0001 00000020:00000080:0.0:1789478580.800783:0:15853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789478580.800815:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebb027e6000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789478580.800920:0:15853:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789478580.800923:0:15853:0:(genops.c:885:class_export_put()) final put ffff8ebb027e0800/lustre-OST0001_UUID 00000020:00000080:0.0:1789478580.800926:0:15853:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebb027e0800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789478580.800933:0:15853:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789478580.801040:0:15853:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c56e5039-4535-4d8a-bd01-962355b55f9c->MGS 00010000:00010000:0.0:1789478580.801166:0:15853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc421ece00/0x8ebaae74e82159c8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ebaae74e82159cf expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478580.801179:0:15853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc421ece00/0x8ebaae74e82159c8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ebaae74e82159cf expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478580.801190:0:15853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789478580.801193:0:15853:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789478580.801196:0:15853:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789478580.801209:0:15853:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ebc187da800 00010000:00010000:0.0:1789478580.801213:0:15853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc421ece00/0x8ebaae74e82159c8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8ebaae74e82159cf expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478580.801228:0:15853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77000/0x8ebaae74e8215e4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ebaae74e8215e52 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478580.803031:0:15853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77000/0x8ebaae74e8215e4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ebaae74e8215e52 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478580.803051:0:15853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789478580.803055:0:15853:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789478580.803057:0:15853:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789478580.803074:0:15853:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ebc187da800 00010000:00010000:0.0:1789478580.803078:0:15853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77000/0x8ebaae74e8215e4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8ebaae74e8215e52 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789478580.803108:0:15853:0:(import.c:65:import_set_state_nolock()) ffff8ebc187da800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789478580.803112:0:15853:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789478580.803119:0:15853:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789478580.803121:0:15853:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789478580.803125:0:15853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789478580.803135:0:15853:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ebc34cb6300 x1876403964499840/t0(0) o250->MGC192.168.206.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789478598 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789478580.803148:0:15853:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789478580.803209:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c56e5039-4535-4d8a-bd01-962355b55f9c:3644:1876403964499840:0@lo:250:kworker.0 00000100:00100000:0.0:1789478580.803345:0:15853:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 10000000:01000000:0.0:1789478580.803349:0:15853:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789478580.803357:0:15853:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e82158c5 00000020:00000080:0.0:1789478580.803363:0:15853:0:(genops.c:885:class_export_put()) final put ffff8ebc187db800/c56e5039-4535-4d8a-bd01-962355b55f9c 00000020:01000000:0.0:1789478580.803382:0:15853:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.111@tcp (flags='') 00000020:00000080:0.0:1789478580.803391:0:15853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789478580.803397:0:15853:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.111@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789478580.803401:0:15853:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8ebc08d93370) has no exports 00000020:00000080:2.0:1789478580.803432:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc187db800/c56e5039-4535-4d8a-bd01-962355b55f9c for MGC192.168.206.111@tcp 10000000:01000000:3.0:1789478580.803479:0:6514:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789478580.803514:0:15853:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.111@tcp: client import never connected 00000100:00080000:0.0:1789478580.803518:0:15853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789478580.803521:0:15853:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789478580.803523:0:15853:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789478580.803533:0:15853:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789478580.803578:0:15853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789478580.803584:0:15853:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.111@tcp (uuid c56e5039-4535-4d8a-bd01-962355b55f9c) 00000020:01000000:0.0:1789478580.803618:0:15853:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789478580.803622:0:15853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789478580.803626:0:15853:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789478580.803631:0:15853:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8ebc34fa9000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789478580.803635:0:15853:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff8ebc34c70000) has exports, disconnecting them 00000020:00080000:0.0:1789478580.803639:0:15853:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8ebc34fa9000), last request at 1789478386 00000020:00000080:0.0:1789478580.803642:0:15853:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215c99 00000020:00080000:0.0:1789478580.803652:0:15853:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ebc34fa9000): rc 0 00000020:00000080:0.0:1789478580.803656:0:15853:0:(genops.c:885:class_export_put()) final put ffff8ebc34fa9000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789478580.803776:0:14273:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc187da800 for MGC192.168.206.111@tcp 00000020:00000080:2.0:1789478580.803783:0:14273:0:(genops.c:885:class_export_put()) final put ffff8ebc187dc800/c56e5039-4535-4d8a-bd01-962355b55f9c 00000020:00000080:2.0:1789478580.803786:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc187dc800/c56e5039-4535-4d8a-bd01-962355b55f9c for MGC192.168.206.111@tcp 00000020:01000000:2.0:1789478580.803793:0:14273:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.111@tcp (c56e5039-4535-4d8a-bd01-962355b55f9c) 00000020:00000080:2.0:1789478580.804245:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc34fa9000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1789478580.808727:0:15853:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789478580.808734:0:15853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789478580.808738:0:15853:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789478580.808745:0:15853:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789478580.808837:0:14273:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebc40ca8000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789478580.809056:0:15853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789478580.809065:0:15853:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789478580.809070:0:15853:0:(genops.c:885:class_export_put()) final put ffff8ebc35e70000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789478580.809074:0:15853:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc35e70000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789478580.809084:0:15853:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1789478580.809143:0:15853:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789478580.809148:0:15853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789478580.809162:0:15853:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789478580.809169:0:15853:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8ebb034e0000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789478580.809175:0:15853:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff8ebc2715cd28) has exports, disconnecting them 00000020:00080000:3.0:1789478580.809180:0:15853:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8ebb034e0000), last request at 1789478386 00000020:00000080:3.0:1789478580.809183:0:15853:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215cae 00000020:00080000:3.0:1789478580.809197:0:15853:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ebb034e0000): rc 0 00000020:00000080:3.0:1789478580.809202:0:15853:0:(genops.c:885:class_export_put()) final put ffff8ebb034e0000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1789478580.809731:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebb034e0000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1789478580.810643:0:15853:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789478580.810649:0:15853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789478580.810653:0:15853:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789478580.810658:0:15853:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789478580.810691:0:14273:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ebb027e4000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1789478580.810746:0:15450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789478580.810862:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1789478580.811638:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1789478580.823624:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1789478580.823824:0:6501:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8ebc184b3c00:6501] 1 exiting: rc = 0 00000100:00100000:0.0:1789478580.823925:0:6500:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8ebc184b3e00:6500] 0 exiting: rc = 1 00000100:00100000:2.0:1789478580.823980:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.824415:0:10392:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8ebc3cbbb800:10392] 4 exiting: rc = 0 00000100:00100000:2.0:1789478580.824420:0:6504:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8ebc2c8ff600:6504] 2 exiting: rc = 0 00000100:00100000:0.0:1789478580.824505:0:6502:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8ebc2c8ff200:6502] 0 exiting: rc = 1 00000100:00100000:0.0:1789478580.824645:0:6503:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8ebc2c8fe400:6503] 1 exiting: rc = 0 00000100:00100000:0.0:1789478580.824719:0:8446:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8ebb01b46800:8446] 3 exiting: rc = 0 00000100:00100000:2.0:1789478580.824824:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.824832:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.824848:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.824854:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.824861:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.824869:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.824874:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.824882:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.824889:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.824895:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.824901:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.824905:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.824911:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.824917:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.824923:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.824929:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.824934:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.824941:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.824947:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.824953:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.824958:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.824963:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.824971:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.824978:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.824994:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825359:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825369:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825373:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825378:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825383:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825389:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825394:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825399:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825404:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825409:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825420:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825426:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825445:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825451:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825456:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825462:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825466:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825471:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825477:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825482:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825487:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825492:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825498:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825503:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825509:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825514:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825519:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825525:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825530:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825535:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825540:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825545:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825550:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825555:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825560:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825566:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825571:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825575:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.825581:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789478580.826535:0:15853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789478580.826545:0:15853:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1789478580.826550:0:15853:0:(genops.c:885:class_export_put()) final put ffff8ebb027e5000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1789478580.826554:0:15853:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebb027e5000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1789478580.826677:0:15853:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1789478580.826722:0:15853:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ebc3f6c1800 1 00000020:00000080:2.0:1789478580.826727:0:15853:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ebaae74e8215c3e 00000020:00000080:2.0:1789478580.826741:0:15853:0:(genops.c:885:class_export_put()) final put ffff8ebb01bde800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1789478580.826803:0:15853:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1789478580.826831:0:15853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789478580.826836:0:15853:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789478580.826839:0:15853:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff8ebb0229cd28) has no exports 00000020:00000080:0.0:1789478580.830703:0:14273:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebb01bde800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789478580.865353:0:15853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789478580.865366:0:15853:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789478580.865372:0:15853:0:(genops.c:885:class_export_put()) final put ffff8ebc3f6c2800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789478580.865377:0:15853:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc3f6c2800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789478580.865386:0:15853:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789478580.869658:0:15853:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ebc3f6c3000 00000020:01000000:1.0:1789478580.869756:0:15853:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789478580.869764:0:15853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789478580.869769:0:15853:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789478580.869773:0:15853:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8ebc271599b8) has no exports 00000020:00000080:1.0:1789478580.869808:0:15853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789478580.869817:0:15853:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789478580.869821:0:15853:0:(genops.c:885:class_export_put()) final put ffff8ebc40ef7800/OSS_uuid 00000020:00000080:1.0:1789478580.869824:0:15853:0:(genops.c:844:class_export_destroy()) destroying export ffff8ebc40ef7800/OSS_uuid for OSS 00000020:01000000:1.0:1789478580.869830:0:15853:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1789478580.869909:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8ebc40ca2200:8432] 2 exiting: rc = 0 00000100:00100000:1.0:1789478580.870915:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8ebc2c8fe800:8430] 0 exiting: rc = 1 00000100:00100000:1.0:1789478580.870996:0:8829:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8ebb02290600:8829] 3 exiting: rc = 0 00000100:00100000:0.0:1789478580.871154:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8ebc40ca2600:8431] 1 exiting: rc = 0 00000100:00100000:2.0:1789478580.871384:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871393:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:3.0:1789478580.871400:0:6513:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789478580.871401:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871411:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871419:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871428:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871437:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871446:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871456:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871463:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871472:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871478:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871484:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871754:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871759:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871769:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871774:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871780:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871785:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871790:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871795:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871800:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871806:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871811:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871816:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871821:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871826:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871831:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871836:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871841:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871856:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.871861:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872121:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872130:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872135:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872140:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872146:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872151:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872156:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872161:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872166:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872173:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872178:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872184:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872189:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872195:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872200:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872206:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872212:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872217:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872222:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872227:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872233:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872239:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872245:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872251:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872258:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872263:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872269:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872763:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872774:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872780:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872785:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.872791:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.874301:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8ebc40ddbe00:8434] 1 exiting: rc = 0 00000100:00100000:2.0:1789478580.874466:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8ebc40ca2000:8433] 0 exiting: rc = 1 00000100:00100000:0.0:1789478580.875804:0:11355:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8ebc359ab800:11355] 2 exiting: rc = 0 00000100:00100000:1.0:1789478580.876253:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876263:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876269:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876273:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876461:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876466:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876472:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876477:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876483:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876497:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876502:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876508:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876514:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876520:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876525:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876530:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876535:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876540:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876545:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876550:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876555:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876560:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876565:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876570:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876575:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876580:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876585:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876590:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876616:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876621:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876626:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876631:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876636:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876642:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876786:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876794:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876799:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876805:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876809:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876814:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876818:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876823:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876827:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876832:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876837:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876843:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876848:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876853:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876858:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876864:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876869:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876874:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876881:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876886:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876891:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876896:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876901:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876906:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876911:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876916:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876921:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876926:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876931:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.876945:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.878624:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8ebc1a112400:8435] 0 exiting: rc = 1 00000100:00100000:3.0:1789478580.878950:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8ebc271bce00:8437] 2 exiting: rc = 0 00000100:00100000:1.0:1789478580.878977:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8ebc1a112600:8436] 1 exiting: rc = 0 00000100:00100000:1.0:1789478580.879129:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879137:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879143:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879158:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879165:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879170:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879175:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879180:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879185:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879192:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879197:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879202:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879207:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879213:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879218:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879223:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879229:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879247:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879253:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879258:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879265:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879270:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879344:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879352:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879358:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879380:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879388:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879393:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879398:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879404:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879410:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879416:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879422:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879428:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879433:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879439:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879444:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879449:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879462:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879468:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879473:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879479:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879484:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879558:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879565:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879570:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879575:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879581:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879586:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879627:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879635:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879640:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879645:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879650:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879655:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879744:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879753:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879767:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879774:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879779:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879792:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879799:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879811:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.879818:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789478580.885157:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8ebc35bcda00:8439] 1 exiting: rc = 0 00000100:00100000:3.0:1789478580.885241:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8ebc34e41000:8438] 0 exiting: rc = 1 00000100:00100000:0.0:1789478580.885397:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885406:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885413:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885423:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885431:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885438:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885445:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885453:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885469:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885486:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885492:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885498:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885503:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885508:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885513:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885517:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885522:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885527:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885533:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885538:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885543:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885549:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885554:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885833:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885845:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885853:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885861:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885870:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885876:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885881:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885886:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885892:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885900:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885908:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885916:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885924:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885932:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885937:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885942:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885948:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885957:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.885967:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.887137:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.887156:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.887162:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.887167:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.887172:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.887176:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.887181:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.887186:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.887191:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.887195:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.887200:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.887205:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.887210:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.887221:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.887227:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.887232:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.887237:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.887242:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.887247:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.887252:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.887257:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789478580.887261:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789478580.889833:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8ebc359aa600:8441] 1 exiting: rc = 0 00000100:00100000:2.0:1789478580.890203:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8ebc3bca0200:8440] 0 exiting: rc = 1 00000100:00100000:1.0:1789478580.890321:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890329:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890335:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890341:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890347:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890353:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890359:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890366:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890373:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890389:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890396:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890414:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890422:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890428:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890435:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890441:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890447:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890452:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890457:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890462:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890467:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890472:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890478:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890508:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890516:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890521:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890526:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890532:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890538:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890544:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890549:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890556:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890561:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890566:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890571:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890591:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890618:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890624:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890630:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890635:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890640:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890646:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890652:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890658:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890874:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890880:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890885:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890906:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890926:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890932:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890940:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890945:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890952:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890958:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890963:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890970:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890976:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890981:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.890997:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.891018:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.891026:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.891032:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.891105:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789478580.891121:0:15853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1789478580.902658:0:15853:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789478597.518831:0:16619:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789478606.913064:0:17218:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789478606.913070:0:17218:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1789478606.913072:0:17218:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789478606.913181:0:17218:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ebb0372d800 00000020:01000004:1.0:1789478606.913195:0:17218:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1789478606.913202:0:17218:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789478606.913217:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8ebc3f734d28) 00000020:00000080:1.0:1789478606.913229:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789478607.014474:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789478607.015084:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789478607.020648:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1789478607.021151:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1789478607.021485:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789478607.021882:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1789478607.022170:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789478607.022430:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789478607.022694:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1789478607.022896:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789478607.023082:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789478607.023273:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789478607.023584:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1789478607.023791:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1789478607.025571:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1789478607.027290:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1789478607.027620:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1789478607.027871:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1789478607.028101:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1789478607.028522:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789478607.028739:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1789478607.028975:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789478607.029202:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1789478607.029476:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789478607.029696:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1789478607.029964:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789478607.030192:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1789478607.030523:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1789478607.030782:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789478607.031028:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789478607.031271:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1789478607.031629:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1789478607.031872:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1789478607.032116:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1789478607.032502:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1789478607.034434:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789478607.035029:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1789478607.035261:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789478607.035490:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789478607.035730:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789478607.035958:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789478607.036211:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1789478607.036444:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1789478607.036655:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789478607.036857:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789478607.037203:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1789478607.037496:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1789478607.037917:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1789478607.041548:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1789478607.042525:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1789478607.043330:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1789478607.045675:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1789478607.046537:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1789478607.047506:0:17218:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789478607.048381:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789478607.048399:0:17218:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789478607.048410:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ebaae74e8216e82 00000020:01000004:3.0:1789478607.048416:0:17218:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1789478607.048421:0:17218:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789478607.048425:0:17218:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ebb0372d800 from MGS 00000020:01000004:3.0:1789478607.048429:0:17218:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789478607.048439:0:17218:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8ebb02298000) 00000020:00000080:3.0:1789478607.048450:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789478607.048509:0:17218:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ebb0372d800 from MGS, refs=2 00080000:01000000:3.0:1789478607.048514:0:17218:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789478607.048518:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ebaae74e8216e90 00000100:00100000:3.0:1789478607.048630:0:17218:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789478607.048755:0:17218:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789478607.048762:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789478607.049464:0:17218:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789478607.049471:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789478607.050169:0:17218:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789478607.050350:0:17218:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789478607.050449:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789478607.051007:0:17218:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789478607.051015:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789478607.051301:0:17218:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789478607.051307:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789478607.051966:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478607.051969:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478607.051971:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478607.052229:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478607.052232:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478607.052233:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478607.054129:0:17218:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789478607.058471:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789478607.060794:0:17218:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1789478607.061628:0:17230:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789478607.061710:0:17218:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789478607.061752:0:17218:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789478607.062503:0:17218:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789478607.062989:0:17218:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789478607.063188:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789478607.063195:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789478607.065085:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789478607.065095:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789478607.065509:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789478607.065515:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789478607.066184:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789478607.066206:0:17218:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.111@tcp' 00000020:01000004:0.0:1789478607.066213:0:17218:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789478607.066242:0:17218:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.111@tcp (typ=mgc) 00000020:00000080:0.0:1789478607.066254:0:17218:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.111@tcp (ffff8ebc40f719b8) 00000020:00000080:0.0:1789478607.066268:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789478607.066532:0:17218:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ebb03f6b800@MGC192.168.206.111@tcp: add connection 192.168.206.111@tcp at head 00010000:00010000:0.0:1789478607.066719:0:17218:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.111@tcp-0 is initialized 00000040:01000000:0.0:1789478607.066725:0:17218:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789478607.067038:0:17235:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789478607.070016:0:17236:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789478607.070130:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.111@tcp (uuid d53a32c3-7c45-4781-893e-f633d5432f2d) 00000020:00000080:0.0:1789478607.070154:0:17218:0:(genops.c:1385:class_connect()) connect: client d53a32c3-7c45-4781-893e-f633d5432f2d, cookie 0x8ebaae74e8216e9e 00000100:00080000:0.0:1789478607.070168:0:17218:0:(import.c:510:import_select_connection()) MGC192.168.206.111@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789478607.070181:0:17218:0:(import.c:625:import_select_connection()) MGC192.168.206.111@tcp: import ffff8ebb03f6b800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1789478607.070220:0:17218:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb03fece00 x1876403964499968/t0(0) o250->MGC192.168.206.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789478607.070252:0:17218:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d53a32c3-7c45-4781-893e-f633d5432f2d->MGS 00000020:01000004:0.0:1789478607.070282:0:17218:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789478607.070288:0:17218:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789478607.070317:0:17218:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8ebc40f73370) 00000020:00000080:0.0:1789478607.070331:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789478607.071763:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d53a32c3-7c45-4781-893e-f633d5432f2d:3644:1876403964499968:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789478607.071834:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478607.074163:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964499968 00000100:00100000:3.0:1789478607.074180:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964499968 00000100:00100000:3.0:1789478607.074271:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789478607.074280:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1876403964499968:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1789478607.074328:0:17232:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d53a32c3-7c45-4781-893e-f633d5432f2d@0@lo t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:3.0:1789478607.074355:0:17232:0:(genops.c:1385:class_connect()) connect: client d53a32c3-7c45-4781-893e-f633d5432f2d, cookie 0x8ebaae74e8216eac 00000100:00080000:3.0:1789478607.074483:0:17232:0:(import.c:65:import_set_state_nolock()) ffff8ebc3bd0c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789478607.074575:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+5:3644:x1876403964499968:12345-0@lo:250:mount.lustre.0 Request processed in 294us (2740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478607.074583:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789478607.075036:0:3644:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.111@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789478607.075045:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) MGC192.168.206.111@tcp: connect to target with instance 0 00000100:00080000:2.0:1789478607.075053:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) MGC192.168.206.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789478607.075057:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789478607.075239:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebb03f6b800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789478607.075243:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789478607.075256:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789478607.075263:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d53a32c3-7c45-4781-893e-f633d5432f2d:3644:1876403964499968:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789478607.079398:0:17218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789478607.079639:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789478607.079646:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789478607.080491:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789478607.080641:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789478607.081486:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789478607.081945:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789478607.083432:0:17218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789478607.085136:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789478607.085144:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789478607.086270:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789478607.086281:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789478607.138258:0:17218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789478607.138838:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789478607.138845:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789478607.140334:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789478607.140345:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789478607.141221:0:17218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789478607.142870:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789478607.142879:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789478607.143953:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789478607.143964:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789478607.146745:0:17218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789478607.146936:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789478607.146942:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789478607.150241:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789478607.150259:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789478607.156009:0:17218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789478607.156184:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789478607.156190:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789478607.160158:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789478607.160170:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789478607.195996:0:17218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789478607.196278:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789478607.196285:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789478607.199238:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789478607.199252:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789478607.203627:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789478607.203640:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789478607.204926:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789478607.204954:0:17218:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1789478607.204961:0:17218:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789478607.205059:0:17218:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789478607.205174:0:17218:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.111@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1789478607.205179:0:17218:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789478607.205180:0:17218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789478607.205182:0:17218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789478607.205183:0:17218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789478607.205184:0:17218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789478607.205185:0:17218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789478607.205187:0:17218:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789478607.205188:0:17218:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789478607.205190:0:17218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789478607.205196:0:17218:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789478607.205198:0:17218:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1789478607.205200:0:17218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789478607.205201:0:17218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789478607.205202:0:17218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789478607.205203:0:17218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789478607.205204:0:17218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789478607.205205:0:17218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789478607.205206:0:17218:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789478607.205207:0:17218:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789478607.205208:0:17218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789478607.205209:0:17218:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789478607.205231:0:17218:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789478607.205250:0:17218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964500096:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789478607.205316:0:17218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478607.205360:0:17218:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478607.206266:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964500096 00000100:00100000:0.0:1789478607.206275:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964500096 00000100:00100000:0.0:1789478607.206364:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789478607.206373:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+5:17218:x1876403964500096:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789478607.206418:0:17234:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789478607.206422:0:17234:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789478607.206424:0:17234:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789478607.206719:0:17254:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789478607.208673:0:17234:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1789478607.216189:0:17255:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789478607.216196:0:17255:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1789478607.216199:0:17255:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789478607.216202:0:17255:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789478607.216469:0:17255:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1789478607.216901:0:17234:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789478607.216912:0:17234:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789478607.219190:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+5:17218:x1876403964500096:12345-0@lo:253:mount.lustre.0 Request processed in 12809us (13864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478607.219206:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789478607.219237:0:17218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964500096:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789478607.219257:0:17218:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789478607.219261:0:17218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789478607.219263:0:17218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789478607.219264:0:17218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789478607.219266:0:17218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789478607.219267:0:17218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789478607.219269:0:17218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789478607.219270:0:17218:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789478607.219272:0:17218:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789478607.219274:0:17218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789478607.219275:0:17218:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789478607.219296:0:17218:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ebb0372d800 from lustre-MDT0000 10000000:01000000:3.0:1789478607.219327:0:17218:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789478607.219341:0:17218:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789478607.219346:0:17218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8ebc40f719b8 10000000:01000000:3.0:1789478607.219363:0:17218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789478607.219373:0:17218:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ebc40f719b8 from 1 10000000:01000000:3.0:1789478607.219377:0:17218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789478607.219416:0:17218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.219427:0:17218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.219438:0:17218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478607.219469:0:17218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964500224:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789478607.219518:0:17218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478607.219560:0:17218:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f2780 going to sleep for 11 seconds 00000100:00100000:0.0:1789478607.219882:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964500224 00000100:00100000:0.0:1789478607.219889:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964500224 00000100:00100000:0.0:1789478607.219935:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789478607.219944:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+5:17218:x1876403964500224:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789478607.219960:0:17232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478607.219975:0:17232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc029de400/0x8ebaae74e8216eba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8216eb3 expref: -99 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478607.220009:0:17232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc029de400/0x8ebaae74e8216eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8216eb3 expref: 6 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478607.220019:0:17232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc029de400/0x8ebaae74e8216eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8216eb3 expref: 6 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478607.220028:0:17232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029de400, rc 0) 00000100:00100000:0.0:1789478607.220145:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+6:17218:x1876403964500224:12345-0@lo:101:mount.lustre.0 Request processed in 201us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478607.220152:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789478607.220413:0:17218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964500224:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789478607.220428:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216eb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216eba expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.220438:0:17218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216eb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8216eba expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478607.220496:0:17218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964500352:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789478607.220522:0:17218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478607.220552:0:17218:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f2780 going to sleep for 11 seconds 00000100:00100000:0.0:1789478607.220629:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964500352 00000100:00100000:0.0:1789478607.220633:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964500352 00000100:00100000:2.0:1789478607.220732:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789478607.220743:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+6:17218:x1876403964500352:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789478607.220826:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+6:17218:x1876403964500352:12345-0@lo:501:mount.lustre.0 Request processed in 86us (302us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789478607.220833:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789478607.222656:0:17218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964500352:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789478607.222703:0:17218:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789478607.222720:0:17218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216eb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216eba expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478607.222730:0:17218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216eba expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478607.222738:0:17218:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ebb0372d800 10000000:01000000:0.0:1789478607.222745:0:17218:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789478607.222750:0:17218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ebb0372d800 10000000:01000000:0.0:1789478607.222753:0:17218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789478607.222756:0:17218:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ebb0372d800 from 1 10000000:01000000:0.0:1789478607.222759:0:17218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789478607.222790:0:17218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc029df000/0x8ebaae74e8216ec1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478607.222828:0:17218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc029df000/0x8ebaae74e8216ec1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478607.222843:0:17218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc029df000/0x8ebaae74e8216ec1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478607.222871:0:17218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03feca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964500480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789478607.222922:0:17218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478607.222951:0:17218:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05483600 going to sleep for 11 seconds 00000100:00100000:1.0:1789478607.223101:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964500480 00000100:00100000:1.0:1789478607.223108:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964500480 00000100:00100000:1.0:1789478607.223155:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789478607.223167:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+6:17218:x1876403964500480:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789478607.223179:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478607.223196:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc08c4a000/0x8ebaae74e8216ec8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8216ec1 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478607.223218:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc08c4a000/0x8ebaae74e8216ec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8216ec1 expref: 7 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478607.223230:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc08c4a000/0x8ebaae74e8216ec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8216ec1 expref: 7 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478607.223239:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4a000, rc 0) 00000100:00100000:1.0:1789478607.223336:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+7:17218:x1876403964500480:12345-0@lo:101:mount.lustre.0 Request processed in 171us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478607.223343:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789478607.223424:0:17218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03feca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964500480:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789478607.223435:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc029df000/0x8ebaae74e8216ec1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216ec8 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478607.223445:0:17218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc029df000/0x8ebaae74e8216ec1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8216ec8 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478607.223457:0:17218:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789478607.223472:0:17218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc029df000/0x8ebaae74e8216ec1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216ec8 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478607.223693:0:17218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc029df000/0x8ebaae74e8216ec1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216ec8 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478607.223701:0:17218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789478607.223705:0:17218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789478607.223709:0:17218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ebb0372d800 10000000:01000000:0.0:1789478607.223712:0:17218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789478607.223723:0:17218:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789478607.223726:0:17218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789478607.223741:0:17218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc029dee00/0x8ebaae74e8216ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478607.223748:0:17218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc029dee00/0x8ebaae74e8216ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478607.223755:0:17218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc029dee00/0x8ebaae74e8216ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478607.223769:0:17218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03feca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964500608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789478607.223799:0:17218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478607.223928:0:17218:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05483600 going to sleep for 11 seconds 00000100:00100000:0.0:1789478607.224748:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964500608 00000100:00100000:0.0:1789478607.224757:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964500608 00000100:00100000:0.0:1789478607.224871:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789478607.224881:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+7:17218:x1876403964500608:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789478607.224895:0:17232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478607.224909:0:17232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc029dfe00/0x8ebaae74e8216ed6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8216ecf expref: -99 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478607.224930:0:17232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc029dfe00/0x8ebaae74e8216ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8216ecf expref: 8 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478607.224939:0:17232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc029dfe00/0x8ebaae74e8216ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8216ecf expref: 8 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478607.224946:0:17232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029dfe00, rc 0) 00000100:00100000:0.0:1789478607.224997:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+8:17218:x1876403964500608:12345-0@lo:101:mount.lustre.0 Request processed in 118us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478607.225014:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789478607.225224:0:17218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03feca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964500608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789478607.225239:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc029dee00/0x8ebaae74e8216ecf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216ed6 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478607.225249:0:17218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc029dee00/0x8ebaae74e8216ecf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8216ed6 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478607.225308:0:17218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03feca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964500736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789478607.225337:0:17218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478607.225469:0:17218:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05483600 going to sleep for 11 seconds 00000100:00100000:1.0:1789478607.225612:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964500736 00000100:00100000:1.0:1789478607.225618:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964500736 00000100:00100000:1.0:1789478607.225720:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789478607.225728:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+8:17218:x1876403964500736:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789478607.225903:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+9:17218:x1876403964500736:12345-0@lo:501:mount.lustre.0 Request processed in 175us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478607.225910:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789478607.225975:0:17218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03feca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964500736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789478607.226002:0:17218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03feca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964500864:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789478607.226037:0:17218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478607.226107:0:17218:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05483600 going to sleep for 11 seconds 00000100:00100000:1.0:1789478607.226208:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964500864 00000100:00100000:1.0:1789478607.226218:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964500864 00000100:00100000:1.0:1789478607.226243:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789478607.226250:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+9:17218:x1876403964500864:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789478607.227415:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+9:17218:x1876403964500864:12345-0@lo:503:mount.lustre.0 Request processed in 1161us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478607.227426:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789478607.227699:0:17218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03feca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964500864:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789478607.229297:0:17256:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d53a32c3-7c45-4781-893e-f633d5432f2d:17256:1876403964500992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789478607.229440:0:17256:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478607.229730:0:17256:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc0834c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478607.234438:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964500992 00000100:00100000:1.0:1789478607.234573:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964500992 00000100:00100000:1.0:1789478607.238296:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789478607.238315:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+9:17256:x1876403964500992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789478607.239349:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+9:17256:x1876403964500992:12345-0@lo:502:llog_process_th.0 Request processed in 1038us (9904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478607.239493:0:17256:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d53a32c3-7c45-4781-893e-f633d5432f2d:17256:1876403964500992:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789478607.239533:0:17256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789478607.239550:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478607.239552:0:17256:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789478607.239558:0:17256:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789478607.239561:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789478607.239575:0:17256:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8ebc2715cd28) 00000020:00000080:2.0:1789478607.239614:0:17256:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789478607.239620:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789478607.239699:0:17256:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789478607.239706:0:17256:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ebaae74e8216ee4 00000020:00000080:2.0:1789478607.239912:0:17256:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789478607.239916:0:17256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789478607.239919:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478607.239920:0:17256:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789478607.239923:0:17256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789478607.239926:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478607.239928:0:17256:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789478607.239931:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789478607.239938:0:17256:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8ebc27158000) 00000020:00000080:2.0:1789478607.239947:0:17256:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789478607.239950:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789478607.239952:0:17256:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789478607.239955:0:17256:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789478607.239960:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789478607.239999:0:17256:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ebb0372d800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789478607.240011:0:17256:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8ebc271599b8) 00000020:00000080:2.0:1789478607.240018:0:17256:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789478607.240078:0:17256:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789478607.240314:0:17256:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8ebaae74e8216ef9 00000020:00000080:2.0:1789478607.240585:0:17256:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789478607.240615:0:17256:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789478607.240621:0:17256:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8ebaae74e8216f00 00080000:01000000:2.0:1789478607.240627:0:17256:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789478607.240630:0:17256:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ebaae74e8216f07 00000100:00100000:1.0:1789478607.240999:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1789478607.314945:0:17256:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789478607.315650:0:17256:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1789478607.316128:0:17256:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789478607.316716:0:17256:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8ebb0229cd28) 00000020:00000080:3.0:1789478607.316734:0:17256:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789478607.316813:0:17256:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789478607.316821:0:17256:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ebaae74e8216f15 00000020:00000080:3.0:1789478607.319160:0:17256:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789478607.325830:0:17256:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8ebaae74e8216f1c 00000020:00000080:3.0:1789478607.326221:0:17256:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789478607.326230:0:17256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789478607.326236:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478607.326238:0:17256:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789478607.326242:0:17256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789478607.326244:0:17256:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1789478607.326246:0:17256:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789478607.326247:0:17256:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789478607.326248:0:17256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789478607.326251:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478607.326252:0:17256:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789478607.326254:0:17256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789478607.326259:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478607.326260:0:17256:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789478607.326265:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789478607.326298:0:17256:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789478607.326313:0:17256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789478607.326317:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478607.326318:0:17256:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789478607.326321:0:17256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789478607.326324:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478607.326325:0:17256:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789478607.326328:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789478607.326333:0:17256:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:00000080:3.0:1789478607.326368:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789478607.326388:0:17256:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8ebb022999b8) 00000020:00000080:3.0:1789478607.326401:0:17256:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789478607.326407:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789478607.326460:0:17256:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789478607.326466:0:17256:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789478607.326472:0:17256:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ebaae74e8216f2a 00010000:00080000:3.0:1789478607.326501:0:17256:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ebc3f6c1000@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.111@tcp at head 00010000:00010000:2.0:1789478607.329012:0:17256:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1789478607.330287:0:17256:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789478607.330301:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789478607.330337:0:17256:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789478607.330432:0:17256:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8ebaae74e8216f31 00000100:00080000:3.0:1789478607.330443:0:17256:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789478607.330454:0:17256:0:(import.c:625:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ebc3f6c1000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1789478607.330486:0:17256:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb03598a80 x1876403964501120/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789478607.330564:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964501120:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789478607.330677:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789478607.330763:0:17256:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1789478607.330821:0:17256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789478607.330826:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478607.330828:0:17256:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1789478607.330831:0:17256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789478607.330834:0:17256:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1789478607.330835:0:17256:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789478607.330837:0:17256:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789478607.330838:0:17256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789478607.330841:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478607.330842:0:17256:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789478607.330844:0:17256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789478607.330859:0:17256:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789478607.330863:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478607.330864:0:17256:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789478607.330868:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789478607.330877:0:17256:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:01000000:3.0:1789478607.330897:0:17256:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789478607.330899:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789478607.330911:0:17256:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8ebb0229b370) 00000020:00000080:3.0:1789478607.330922:0:17256:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789478607.330927:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789478607.330994:0:17256:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789478607.331001:0:17256:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789478607.331007:0:17256:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ebaae74e8216f3f 00010000:00080000:3.0:1789478607.331041:0:17256:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ebc3bcd8800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.111@tcp at head 00010000:00010000:3.0:1789478607.331248:0:17256:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1789478607.332385:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964501120 00000100:00100000:0.0:1789478607.332396:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964501120 00000100:00100000:0.0:1789478607.332429:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789478607.332437:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876403964501120:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1789478607.332453:0:17243:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:3.0:1789478607.335327:0:17256:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789478607.335695:0:17256:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789478607.338903:0:17256:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789478607.339845:0:17256:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789478607.348297:0:17256:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789478607.350569:0:17262:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789478607.350575:0:17262:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1789478607.361443:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876403964501120:12345-0@lo:38:llog_process_th.0 Request processed in 28997us (30758us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789478607.361471:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789478607.361478:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc3f6c1000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789478607.361483:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789478607.361486:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964501120:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1789478607.362075:0:17256:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789478607.362088:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789478607.362131:0:17256:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789478607.362152:0:17256:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8ebaae74e8216f46 00000100:00080000:1.0:1789478607.362160:0:17256:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789478607.362169:0:17256:0:(import.c:625:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ebc3bcd8800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1789478607.362202:0:17256:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb037e4700 x1876403964501248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789478607.364538:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964501248:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789478607.364624:0:3644:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876403964501248 offset 0 length 520: 4 00000100:00080000:2.0:1789478607.364881:0:17256:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789478607.364974:0:17256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789478607.364981:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478607.364983:0:17256:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789478607.364987:0:17256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789478607.364990:0:17256:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1789478607.364992:0:17256:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789478607.364993:0:17256:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789478607.364995:0:17256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789478607.364997:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478607.364999:0:17256:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789478607.365001:0:17256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789478607.365006:0:17256:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789478607.365010:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478607.365011:0:17256:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789478607.365014:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789478607.365018:0:17256:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:01000000:2.0:1789478607.365040:0:17256:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789478607.365043:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789478607.365060:0:17256:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ebc2715b370) 00000020:00000080:2.0:1789478607.365078:0:17256:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1789478607.365098:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789478607.365183:0:17256:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789478607.365189:0:17256:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1789478607.365197:0:17256:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ebaae74e8216f54 00010000:00080000:2.0:1789478607.365244:0:17256:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ebc06fa9800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.111@tcp at head 00010000:00010000:2.0:1789478607.365481:0:17256:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1789478607.365547:0:17256:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789478607.365563:0:17256:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789478607.368370:0:17256:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789478607.368787:0:17256:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789478607.368952:0:17256:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1789478607.371841:0:17264:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789478607.371861:0:17264:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789478607.373260:0:17256:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789478607.373272:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789478607.373507:0:17256:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789478607.373532:0:17256:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8ebaae74e8216f5b 00000100:00080000:3.0:1789478607.373543:0:17256:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789478607.373554:0:17256:0:(import.c:625:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ebc06fa9800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1789478607.373591:0:17256:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb03598a80 x1876403964501376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789478607.374338:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964501376:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789478607.374412:0:3644:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876403964501376 offset 0 length 520: 4 00000100:00080000:3.0:1789478607.374521:0:17256:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789478607.374605:0:17256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789478607.374611:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478607.374613:0:17256:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789478607.374616:0:17256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789478607.374619:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478607.374621:0:17256:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789478607.374623:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789478607.374625:0:17256:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789478607.374627:0:17256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789478607.374629:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478607.374630:0:17256:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789478607.374633:0:17256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789478607.374635:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478607.374636:0:17256:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789478607.374639:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789478607.374684:0:17256:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d53a32c3-7c45-4781-893e-f633d5432f2d:17256:1876403964501504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789478607.374732:0:17256:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478607.374748:0:17256:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40e86a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789478607.374888:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964501504 00000100:00100000:1.0:1789478607.374897:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964501504 00000100:00100000:1.0:1789478607.374945:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789478607.374954:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+9:17256:x1876403964501504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789478607.375068:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+9:17256:x1876403964501504:12345-0@lo:502:llog_process_th.0 Request processed in 115us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478607.375075:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789478607.375249:0:17256:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d53a32c3-7c45-4781-893e-f633d5432f2d:17256:1876403964501504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789478607.375272:0:17256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789478607.375277:0:17256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478607.375279:0:17256:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789478607.375283:0:17256:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789478607.375776:0:17218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1789478607.375796:0:17218:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789478607.375810:0:17218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc029dee00/0x8ebaae74e8216ecf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216ed6 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478607.375822:0:17218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc029dee00/0x8ebaae74e8216ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216ed6 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478607.375830:0:17218:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ebb0372d800 from 1 10000000:01000000:1.0:1789478607.375833:0:17218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789478607.375870:0:17218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ae00/0x8ebaae74e8216f62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478607.375879:0:17218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ae00/0x8ebaae74e8216f62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478607.375890:0:17218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ae00/0x8ebaae74e8216f62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478607.375906:0:17218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964501632:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789478607.375943:0:17218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478607.375976:0:17218:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb026473c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478607.376873:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964501632 00000100:00100000:3.0:1789478607.376884:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964501632 00000100:00100000:3.0:1789478607.376941:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789478607.376951:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+9:17218:x1876403964501632:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789478607.376966:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478607.376996:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebb035fd600/0x8ebaae74e8216f69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8216f62 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.377018:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebb035fd600/0x8ebaae74e8216f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8216f62 expref: 10 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.377029:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebb035fd600/0x8ebaae74e8216f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8216f62 expref: 10 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.377038:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fd600, rc 0) 00000100:00100000:3.0:1789478607.377088:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+10:17218:x1876403964501632:12345-0@lo:101:mount.lustre.0 Request processed in 138us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478607.377094:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789478607.377327:0:17218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964501632:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789478607.377344:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ae00/0x8ebaae74e8216f62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216f69 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478607.377353:0:17218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ae00/0x8ebaae74e8216f62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8216f69 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478607.378036:0:17218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964501760:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789478607.378128:0:17218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478607.378159:0:17218:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb026473c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478607.378349:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964501760 00000100:00100000:3.0:1789478607.378356:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964501760 00000100:00100000:3.0:1789478607.378398:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789478607.378407:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+10:17218:x1876403964501760:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789478607.378839:0:17232:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789478607.378845:0:17232:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789478607.379296:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+10:17218:x1876403964501760:12345-0@lo:256:mount.lustre.0 Request processed in 888us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478607.379306:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789478607.379539:0:17218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964501760:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789478607.380909:0:17218:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789478607.380997:0:17218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ae00/0x8ebaae74e8216f62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216f69 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478607.381010:0:17218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ae00/0x8ebaae74e8216f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216f69 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478607.381073:0:17218:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebb0372d800 from 1 10000000:01000000:2.0:1789478607.381077:0:17218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789478607.381254:0:17218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77e00/0x8ebaae74e8216f70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478607.381263:0:17218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77e00/0x8ebaae74e8216f70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478607.381274:0:17218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77e00/0x8ebaae74e8216f70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478607.381297:0:17218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964501888:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789478607.381499:0:17218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478607.381543:0:17218:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc0834c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478607.381637:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964501888 00000100:00100000:1.0:1789478607.381645:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964501888 00000100:00100000:1.0:1789478607.381835:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789478607.381845:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+10:17218:x1876403964501888:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789478607.381868:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478607.381883:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc08c4b000/0x8ebaae74e8216f77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8216f70 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478607.381904:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc08c4b000/0x8ebaae74e8216f77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8216f70 expref: 11 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478607.381915:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc08c4b000/0x8ebaae74e8216f77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8216f70 expref: 11 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478607.381923:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4b000, rc 0) 00000100:00100000:1.0:1789478607.381972:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+11:17218:x1876403964501888:12345-0@lo:101:mount.lustre.0 Request processed in 128us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478607.381979:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789478607.382071:0:17218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964501888:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789478607.382085:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77e00/0x8ebaae74e8216f70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216f77 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478607.382095:0:17218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77e00/0x8ebaae74e8216f70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8216f77 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478607.382171:0:17218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964502016:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789478607.382200:0:17218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478607.382365:0:17218:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc0834c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478607.382867:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964502016 00000100:00100000:3.0:1789478607.382874:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964502016 00000100:00100000:3.0:1789478607.382905:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789478607.382913:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+11:17218:x1876403964502016:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789478607.383052:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+11:17218:x1876403964502016:12345-0@lo:501:mount.lustre.0 Request processed in 139us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478607.383060:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789478607.383857:0:17218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964502016:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789478607.383896:0:17218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964502144:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789478607.383949:0:17218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478607.383986:0:17218:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc0834c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478607.384045:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964502144 00000100:00100000:3.0:1789478607.384050:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964502144 00000100:00100000:3.0:1789478607.384075:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789478607.384094:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+11:17218:x1876403964502144:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789478607.384320:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+11:17218:x1876403964502144:12345-0@lo:503:mount.lustre.0 Request processed in 226us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478607.384329:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789478607.384529:0:17218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964502144:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789478607.385204:0:17266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d53a32c3-7c45-4781-893e-f633d5432f2d:17266:1876403964502272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789478607.385253:0:17266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478607.385289:0:17266:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08f58000 going to sleep for 11 seconds 00000100:00100000:3.0:1789478607.385566:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964502272 00000100:00100000:3.0:1789478607.385572:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964502272 00000100:00100000:3.0:1789478607.385619:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789478607.385628:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+11:17266:x1876403964502272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789478607.386100:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+11:17266:x1876403964502272:12345-0@lo:502:llog_process_th.0 Request processed in 471us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478607.386108:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789478607.386486:0:17266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d53a32c3-7c45-4781-893e-f633d5432f2d:17266:1876403964502272:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789478607.386514:0:17266:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789478607.386524:0:17266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478607.386526:0:17266:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789478607.386532:0:17266:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ebb0372d800 00000020:00000080:2.0:1789478607.386535:0:17266:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789478607.386542:0:17266:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789478607.386545:0:17266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478607.386546:0:17266:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789478607.386549:0:17266:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789478607.386552:0:17266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478607.386553:0:17266:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789478607.386556:0:17266:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ebb0372d800 00000020:00000080:2.0:1789478607.386559:0:17266:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789478607.386641:0:17266:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789478607.386646:0:17266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478607.386658:0:17266:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789478607.386661:0:17266:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789478607.386665:0:17266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478607.386666:0:17266:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789478607.386670:0:17266:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ebb0372d800 00000020:00000080:2.0:1789478607.386678:0:17266:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789478607.386697:0:17266:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789478607.386700:0:17266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478607.386701:0:17266:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789478607.386704:0:17266:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789478607.386706:0:17266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478607.386707:0:17266:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789478607.386710:0:17266:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ebb0372d800 00000020:00000080:2.0:1789478607.386712:0:17266:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789478607.386751:0:17266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d53a32c3-7c45-4781-893e-f633d5432f2d:17266:1876403964502400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789478607.386791:0:17266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478607.386817:0:17266:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc0834c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478607.388732:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964502400 00000100:00100000:1.0:1789478607.388744:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964502400 00000100:00100000:1.0:1789478607.388799:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789478607.388809:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+11:17266:x1876403964502400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789478607.388987:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+11:17266:x1876403964502400:12345-0@lo:502:llog_process_th.0 Request processed in 178us (2194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478607.388995:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789478607.389286:0:17266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d53a32c3-7c45-4781-893e-f633d5432f2d:17266:1876403964502400:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789478607.389460:0:17266:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789478607.389469:0:17266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478607.389471:0:17266:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789478607.389475:0:17266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789478607.389757:0:17218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789478607.389776:0:17218:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789478607.389832:0:17218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77e00/0x8ebaae74e8216f70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216f77 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478607.389844:0:17218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77e00/0x8ebaae74e8216f70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216f77 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478607.389908:0:17218:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789478607.389911:0:17218:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ebb0372d800 10000000:01000000:0.0:1789478607.389913:0:17218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ebb0372d800 10000000:01000000:0.0:1789478607.389917:0:17218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789478607.389923:0:17218:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ebb0372d800 from 1 10000000:01000000:0.0:1789478607.389926:0:17218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789478607.389954:0:17218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc029df800/0x8ebaae74e8216f7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478607.389962:0:17218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc029df800/0x8ebaae74e8216f7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478607.389973:0:17218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc029df800/0x8ebaae74e8216f7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478607.389993:0:17218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964502528:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789478607.390037:0:17218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478607.390087:0:17218:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb02516000 going to sleep for 11 seconds 00000100:00100000:1.0:1789478607.390833:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964502528 00000100:00100000:1.0:1789478607.390841:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964502528 00000100:00100000:1.0:1789478607.391026:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789478607.391036:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+11:17218:x1876403964502528:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789478607.391050:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478607.391368:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc08c4a400/0x8ebaae74e8216f85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8216f7e expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478607.391397:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc08c4a400/0x8ebaae74e8216f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8216f7e expref: 12 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478607.391408:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc08c4a400/0x8ebaae74e8216f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8216f7e expref: 12 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478607.391418:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4a400, rc 0) 00000100:00100000:1.0:1789478607.391526:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+12:17218:x1876403964502528:12345-0@lo:101:mount.lustre.0 Request processed in 490us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478607.391533:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789478607.391660:0:17218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964502528:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789478607.391677:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc029df800/0x8ebaae74e8216f7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216f85 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478607.391686:0:17218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc029df800/0x8ebaae74e8216f7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8216f85 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478607.391769:0:17218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964502656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789478607.391802:0:17218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478607.391831:0:17218:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08f58000 going to sleep for 11 seconds 00000100:00100000:2.0:1789478607.391862:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964502656 00000100:00100000:2.0:1789478607.391866:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964502656 00000100:00100000:2.0:1789478607.392362:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789478607.392371:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+12:17218:x1876403964502656:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789478607.392485:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+12:17218:x1876403964502656:12345-0@lo:501:mount.lustre.0 Request processed in 115us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478607.392491:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789478607.392528:0:17218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964502656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789478607.392557:0:17218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964502784:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789478607.392664:0:17218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478607.392722:0:17218:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08f58000 going to sleep for 11 seconds 00000100:00100000:1.0:1789478607.392903:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964502784 00000100:00100000:1.0:1789478607.392908:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964502784 00000100:00100000:1.0:1789478607.392977:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789478607.392984:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+12:17218:x1876403964502784:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789478607.393077:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+12:17218:x1876403964502784:12345-0@lo:503:mount.lustre.0 Request processed in 91us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478607.393084:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789478607.395488:0:17218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964502784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789478607.396357:0:17268:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d53a32c3-7c45-4781-893e-f633d5432f2d:17268:1876403964502912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789478607.396428:0:17268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478607.396498:0:17268:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb02647480 going to sleep for 11 seconds 00000100:00100000:2.0:1789478607.396543:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964502912 00000100:00100000:2.0:1789478607.396549:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964502912 00000100:00100000:2.0:1789478607.396585:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789478607.396619:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+12:17268:x1876403964502912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789478607.396812:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+12:17268:x1876403964502912:12345-0@lo:502:llog_process_th.0 Request processed in 218us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478607.396819:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789478607.396880:0:17268:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d53a32c3-7c45-4781-893e-f633d5432f2d:17268:1876403964502912:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789478607.396937:0:17268:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789478607.396950:0:17268:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8ebc3f730000) 00000020:00000080:1.0:1789478607.396966:0:17268:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1789478607.397041:0:17268:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ebb0372d800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789478607.397045:0:17268:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ebb0372d800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789478607.397047:0:17268:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ebb0372d800 4 00010000:00080000:1.0:1789478607.397073:0:17268:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ebc3f6c5000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.111@tcp at head 00010000:00010000:2.0:1789478607.403585:0:17268:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1789478607.403833:0:17268:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789478607.403916:0:17268:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789478607.403929:0:17268:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8ebaae74e8216f93 00000100:00080000:2.0:1789478607.403940:0:17268:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789478607.403951:0:17268:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ebc3f6c5000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1789478607.403986:0:17268:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebc34cb6300 x1876403964503040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789478607.404037:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876403964503040:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789478607.404100:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478607.404169:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964503040 00000100:00100000:2.0:1789478607.404175:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964503040 00000100:00100000:2.0:1789478607.404205:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789478607.404213:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876403964503040:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789478607.404262:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876403964503040:12345-0@lo:38:llog_process_th.0 Request processed in 49us (162us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789478607.404270:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789478607.404303:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789478607.404310:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc3f6c5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789478607.404323:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789478607.404327:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876403964503040:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789478607.404358:0:17268:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789478607.406872:0:17268:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d53a32c3-7c45-4781-893e-f633d5432f2d:17268:1876403964503168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789478607.406944:0:17268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478607.406982:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964503168 00000100:00100000:2.0:1789478607.406989:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964503168 00000100:00100000:2.0:1789478607.407027:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789478607.407036:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+12:17268:x1876403964503168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789478607.407555:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+12:17268:x1876403964503168:12345-0@lo:502:llog_process_th.0 Request processed in 518us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478607.407563:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789478607.407641:0:17268:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08316cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478607.407744:0:17268:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d53a32c3-7c45-4781-893e-f633d5432f2d:17268:1876403964503168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789478607.407796:0:17268:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d53a32c3-7c45-4781-893e-f633d5432f2d:17268:1876403964503296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789478607.407832:0:17268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478607.407866:0:17268:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08316cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478607.407977:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964503296 00000100:00100000:3.0:1789478607.407982:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964503296 00000100:00100000:3.0:1789478607.408017:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789478607.408025:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+12:17268:x1876403964503296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789478607.408547:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+12:17268:x1876403964503296:12345-0@lo:502:llog_process_th.0 Request processed in 521us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478607.408555:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789478607.411218:0:17268:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d53a32c3-7c45-4781-893e-f633d5432f2d:17268:1876403964503296:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789478607.417796:0:17268:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789478607.417905:0:17218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789478607.417927:0:17218:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789478607.417944:0:17218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc029df800/0x8ebaae74e8216f7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216f85 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478607.417956:0:17218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc029df800/0x8ebaae74e8216f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216f85 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789478607.418007:0:17218:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789478607.418009:0:17218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789478607.418011:0:17218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478607.418013:0:17218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478607.418014:0:17218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478607.418016:0:17218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478607.418018:0:17218:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789478607.418020:0:17218:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789478607.418021:0:17218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478607.418023:0:17218:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789478607.418027:0:17218:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789478607.418029:0:17218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789478607.418031:0:17218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789478607.418032:0:17218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478607.418033:0:17218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478607.418035:0:17218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478607.418036:0:17218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478607.418037:0:17218:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789478607.418038:0:17218:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789478607.418039:0:17218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478607.418048:0:17218:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789478607.418070:0:17218:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789478607.418090:0:17218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964503424:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789478607.419476:0:17218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478607.419517:0:17218:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08316cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478607.419549:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964503424 00000100:00100000:2.0:1789478607.419556:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964503424 00000100:00100000:2.0:1789478607.419618:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789478607.419629:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+12:17218:x1876403964503424:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789478607.420233:0:17234:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789478607.420247:0:17234:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789478607.423923:0:17234:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789478607.423941:0:17234:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789478607.424227:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+12:17218:x1876403964503424:12345-0@lo:253:mount.lustre.0 Request processed in 4596us (4753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478607.424240:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789478607.424304:0:17218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17218:1876403964503424:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789478607.424487:0:17218:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789478607.424491:0:17218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789478607.424493:0:17218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789478607.424494:0:17218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478607.424496:0:17218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478607.424497:0:17218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478607.424499:0:17218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478607.424500:0:17218:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789478607.424502:0:17218:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789478607.424504:0:17218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478607.424505:0:17218:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789478607.424518:0:17218:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1789478607.426568:0:17254:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789478607.426577:0:17254:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789478607.426631:0:17254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ebb035fd400/0x8ebaae74e8216f9a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.426658:0:17254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebb035fd600/0x8ebaae74e8216f69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8216f62 expref: 11 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.426686:0:17254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ebb035fd400/0x8ebaae74e8216f9a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.426726:0:17254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebb035fd600/0x8ebaae74e8216f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8216f62 expref: 11 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.426741:0:17254:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ebb035fd600/0x8ebaae74e8216f69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8216f62 expref: 11 pid: 17234 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478607.426756:0:17254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17254:1876403964503552:0@lo:104: 00000100:00100000:3.0:1789478607.426815:0:17254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478607.426875:0:17254:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02bf6240 going to sleep for 11 seconds 00000100:00100000:0.0:1789478607.432290:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964503552 00000100:00100000:0.0:1789478607.432303:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964503552 00000100:00100000:0.0:1789478607.432344:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789478607.432367:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03598e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d53a32c3-7c45-4781-893e-f633d5432f2d+3:17254:x1876403964503552:12345-0@lo:104: 00010000:00010000:0.0:1789478607.432383:0:17222:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ae00/0x8ebaae74e8216f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8216f69 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478607.432467:0:17222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789478607.432473:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03598e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d53a32c3-7c45-4781-893e-f633d5432f2d+3:17254:x1876403964503552:12345-0@lo:104: Request processed in 122us (5659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478607.432481:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789478607.432523:0:17254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17254:1876403964503552:0@lo:104: 00010000:00010000:0.0:1789478607.432545:0:17254:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ebb035fd400/0x8ebaae74e8216f9a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.434387:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789478607.434397:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ae00/0x8ebaae74e8216f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8216f69 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.434406:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4ae00 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:3.0:1789478607.434410:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ae00/0x8ebaae74e8216f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8216f69 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.434420:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ae00/0x8ebaae74e8216f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8216f69 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789478607.434427:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ae00/0x8ebaae74e8216f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8216f69 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478607.434432:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789478607.434473:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ae00/0x8ebaae74e8216f62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8216f69 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.434492:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789478607.434519:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ae00/0x8ebaae74e8216f62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8216f69 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.434527:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ae00/0x8ebaae74e8216f62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8216f69 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.434542:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478607.434544:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478607.434546:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478607.434584:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d53a32c3-7c45-4781-893e-f633d5432f2d:3647:1876403964503680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789478607.436270:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478607.436386:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964503680 00000100:00100000:3.0:1789478607.436395:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964503680 00010000:00010000:3.0:1789478607.436424:0:17224:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebb035fd600/0x8ebaae74e8216f69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8216f62 expref: 12 pid: 17234 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478607.436454:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789478607.436462:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03599c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d53a32c3-7c45-4781-893e-f633d5432f2d+12:3647:x1876403964503680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789478607.436487:0:17224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478607.436493:0:17224:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebb035fd600/0x8ebaae74e8216f69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8216f62 expref: 12 pid: 17234 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.436505:0:17224:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebb035fd600/0x8ebaae74e8216f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8216f62 expref: 12 pid: 17234 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.436520:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebb035fd600/0x8ebaae74e8216f69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8216f62 expref: 12 pid: 17234 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.436543:0:17224:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ebb035fd400/0x8ebaae74e8216f9a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.436551:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebb035fd400/0x8ebaae74e8216f9a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789478607.436566:0:17224:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009990423s 00010000:00010000:3.0:1789478607.436571:0:17224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebb035fd400/0x8ebaae74e8216f9a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.436578:0:17224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebb035fd400/0x8ebaae74e8216f9a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.436585:0:17224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ebb035fd400/0x8ebaae74e8216f9a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.436610:0:17224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ebb035fd400/0x8ebaae74e8216f9a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.436617:0:17224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd400 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478607.436622:0:17224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ebb035fd400/0x8ebaae74e8216f9a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.436630:0:17224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ebb035fd400/0x8ebaae74e8216f9a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.436646:0:17224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ebb035fd400/0x8ebaae74e8216f9a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.437234:0:17224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478607.437290:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03599c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d53a32c3-7c45-4781-893e-f633d5432f2d+11:3647:x1876403964503680:12345-0@lo:103:ldlm_bl.0 Request processed in 827us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478607.437297:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789478607.437331:0:17254:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ebb035fd400/0x8ebaae74e8216f9a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.437338:0:17254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ebb035fd400/0x8ebaae74e8216f9a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478607.437344:0:17254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebb035fd400/0x8ebaae74e8216f9a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478607.437780:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d53a32c3-7c45-4781-893e-f633d5432f2d:3647:1876403964503680:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1789478607.461219:0:17218:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789478607.461521:0:17218:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789478607.462028:0:17278:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1789478607.462032:0:17278:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1789478607.462062:0:17279:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789478607.462091:0:17218:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:0.0:1789478607.462525:0:17280:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8ebb03feea00 x1876403964503808/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478607.462536:0:17280:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f29c0 going to sleep for 0 seconds 00000040:00080000:3.0:1789478607.462933:0:17279:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1789478607.463567:0:17218:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789478607.464019:0:17218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789478607.464976:0:17218:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789478607.464988:0:17218:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789478607.465037:0:17218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789478607.466503:0:17218:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789478607.467380:0:17218:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789478607.467423:0:17218:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789478607.467986:0:17279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789478607.468030:0:17279:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1789478607.468952:0:17218:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:2.0:1789478607.469889:0:17218:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1789478607.473012:0:17218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789478607.475067:0:17218:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789478607.475099:0:17218:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9dd90185f988 00100000:10000000:2.0:1789478607.475106:0:17218:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789478607.476226:0:17218:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789478607.476242:0:17218:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789478607.476257:0:17218:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789478607.476279:0:17218:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1789478607.477060:0:17218:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789478607.477245:0:17218:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789478608.100806:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478608.491213:0:17280:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f29c0 going to sleep for 0 seconds 00000040:00080000:0.0:1789478608.497829:0:17274:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789478608.497839:0:17274:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789478608.510274:0:17274:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789478608.510287:0:17274:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:2.0:1789478609.124797:0:17236:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789478609.124805:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ebb0372d800 from 7 10000000:01000000:2.0:1789478609.124810:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789478609.124865:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77c00/0x8ebaae74e8216fa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478609.124877:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77c00/0x8ebaae74e8216fa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478609.124888:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77c00/0x8ebaae74e8216fa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478609.124912:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964503936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789478609.124972:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478609.125054:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc185cc540 going to sleep for 11 seconds 00000100:00100000:1.0:1789478609.125668:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964503936 00000100:00100000:1.0:1789478609.125678:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964503936 00000100:00100000:1.0:1789478609.125735:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789478609.125747:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+11:17236:x1876403964503936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789478609.125762:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478609.125778:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8216fa8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8216fa1 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478609.125805:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8216fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8216fa1 expref: 12 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478609.125831:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8216fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8216fa1 expref: 12 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478609.125853:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4b600, rc 0) 00000100:00100000:1.0:1789478609.125913:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+12:17236:x1876403964503936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478609.125920:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789478609.125971:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964503936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789478609.125986:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77c00/0x8ebaae74e8216fa1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216fa8 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478609.125995:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77c00/0x8ebaae74e8216fa1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8216fa8 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478609.126049:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964504064:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789478609.126089:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478609.126178:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc100433c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789478609.126195:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478609.126353:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964504064 00000100:00100000:0.0:1789478609.126357:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964504064 00000100:00100000:0.0:1789478609.126434:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789478609.126441:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc0a5f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+12:17236:x1876403964504064:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789478609.126456:0:17234:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789478609.126470:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789478609.126474:0:17234:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789478609.126559:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc0a5f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+12:17236:x1876403964504064:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478609.126565:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789478609.126643:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964504064:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789478609.126685:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789478609.126693:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77c00/0x8ebaae74e8216fa1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216fa8 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478609.126702:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77c00/0x8ebaae74e8216fa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216fa8 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478609.508697:0:17280:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f29c0 going to sleep for 0 seconds 00000040:00080000:2.0:1789478609.574496:0:17274:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789478609.574508:0:17274:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789478609.574685:0:17274:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1789478609.574723:0:17274:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789478609.574876:0:17274:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:3.0:1789478610.152256:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478610.532690:0:17280:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f29c0 going to sleep for 0 seconds 00010000:00010000:1.0:1789478611.173839:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478611.559875:0:17280:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f29c0 going to sleep for 0 seconds 00000001:02000400:2.0:1789478611.854786:0:17523:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789478612.204063:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478612.580701:0:17280:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f29c0 going to sleep for 0 seconds 00000100:00080000:2.0:1789478612.708908:0:14273:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789478612.708914:0:14273:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789478612.708918:0:14273:0:(import.c:65:import_set_state_nolock()) ffff8ebc3f6c1000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789478612.708926:0:14273:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 436 00000100:00080000:2.0:1789478612.708932:0:14273:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789478612.708943:0:14273:0:(import.c:625:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ebc3f6c1000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1789478612.708963:0:14273:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebc34cb5180 x1876403964504320/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789478612.708976:0:14273:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789478612.708980:0:14273:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789478612.708983:0:14273:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789478612.708986:0:14273:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789478612.708989:0:14273:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789478612.708992:0:14273:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789478612.708994:0:14273:0:(import.c:65:import_set_state_nolock()) ffff8ebc3f6c5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789478612.709000:0:14273:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ebc3f6c5000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1789478612.709012:0:14273:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebc34cb5f80 x1876403964504448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789478612.709081:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d53a32c3-7c45-4781-893e-f633d5432f2d:3648:1876403964504192:0@lo:400:kworker.0 00000100:00100000:0.0:1789478612.709143:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478612.709214:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964504320:0@lo:38:kworker.0 00000100:00100000:2.0:1789478612.709250:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964504192 00000100:00100000:2.0:1789478612.709260:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964504192 00000100:00100000:3.0:1789478612.709265:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478612.709302:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876403964504448:0@lo:38:kworker.0 00000100:00100000:2.0:1789478612.709308:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789478612.709319:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc02eac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+12:3648:x1876403964504192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478612.709336:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478612.709378:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964504448 00000100:00100000:2.0:1789478612.709381:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc02eac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+12:3648:x1876403964504192:12345-0@lo:400:kworker.0 Request processed in 63us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478612.709383:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964504448 00000100:00100000:2.0:1789478612.709389:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789478612.709409:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789478612.709415:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0359a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876403964504448:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789478612.709435:0:17240:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 441 last 0 00000100:00100000:2.0:1789478612.709451:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d53a32c3-7c45-4781-893e-f633d5432f2d:3648:1876403964504192:0@lo:400:kworker.0 00000020:00000080:1.0:1789478612.709475:0:17240:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8ebaae74e8216faf 00000004:00100000:1.0:1789478612.709496:0:17240:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1789478612.709499:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964504320 00000100:00100000:0.0:1789478612.709506:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964504320 00000100:00100000:0.0:1789478612.709540:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789478612.709545:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0359a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876403964504320:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789478612.709557:0:17244:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1789478612.709677:0:17240:0:(import.c:65:import_set_state_nolock()) ffff8ebb03682800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789478612.709721:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0359a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876403964504448:12345-0@lo:38:kworker.0 Request processed in 305us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478612.709728:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789478612.712813:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ebc34cb5f80 x1876403964504448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789478622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789478612.712845:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789478612.712854:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789478612.712859:0:3644:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789478612.712862:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc3f6c5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789478612.712869:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876403964504448:0@lo:38:kworker.0 00000100:00100000:1.0:1789478612.738035:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0359a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876403964504320:12345-0@lo:38:kworker.0 Request processed in 28479us (28763us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789478612.738055:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789478612.738061:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc3f6c1000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789478612.738069:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789478612.738074:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964504320:0@lo:38:kworker.0 00000020:00000004:3.0:1789478612.845901:0:17575:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789478612.846085:0:17575:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789478613.224917:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478613.613424:0:17280:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f29c0 going to sleep for 0 seconds 00000020:00000004:1.0:1789478613.773944:0:17625:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789478613.774704:0:17625:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789478614.245690:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478614.629583:0:17280:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f29c0 going to sleep for 0 seconds 00010000:00010000:1.0:1789478615.272583:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478615.652696:0:17280:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f29c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789478616.297940:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478616.687381:0:17280:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f29c0 going to sleep for 0 seconds 00010000:00010000:2.0:1789478617.316779:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478617.701015:0:17280:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f29c0 going to sleep for 0 seconds 00000100:00080000:2.0:1789478617.833971:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789478617.833981:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789478617.833991:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ebc3f6c1000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789478617.833999:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 441 00000100:00080000:2.0:1789478617.834005:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789478617.834015:0:37:0:(import.c:625:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ebc3f6c1000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1789478617.834138:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789478607/real 1789478607] req@ffff8ebb03598a80 x1876403964501376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789478617 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478617.834163:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ebb03598a80 x1876403964501376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789478617 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478617.834174:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789478607/real 1789478607] req@ffff8ebb037e4700 x1876403964501248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789478617 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478617.834186:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ebb037e4700 x1876403964501248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789478617 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789478617.834214:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc06fa9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789478617.834229:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789478617.834233:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964501376:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789478617.834238:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc3bcd8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789478617.834244:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789478617.834247:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964501248:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1789478617.834322:0:37:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebc34cb5f80 x1876403964504704/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789478617.834345:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789478617.834349:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789478617.834351:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ebc3bcd8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789478617.834354:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 436 00000100:00080000:2.0:1789478617.834357:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789478617.834363:0:37:0:(import.c:625:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ebc3bcd8800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1789478617.834377:0:37:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebc34cb6d80 x1876403964504832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789478617.834385:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789478617.834388:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789478617.834389:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ebc06fa9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789478617.834392:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 436 00000100:00080000:2.0:1789478617.834395:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789478617.834399:0:37:0:(import.c:625:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ebc06fa9800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1789478617.834409:0:37:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebc34cb4a80 x1876403964504960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789478617.834473:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d53a32c3-7c45-4781-893e-f633d5432f2d:3645:1876403964504576:0@lo:400:kworker.0 00000100:00100000:2.0:1789478617.834532:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478617.834586:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789478617.834615:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964505088:0@lo:400:kworker.0 00000100:00100000:2.0:1789478617.834644:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478617.834695:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964504576 00000100:00100000:2.0:1789478617.834703:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964504576 00000100:00100000:2.0:1789478617.834742:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789478617.834751:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc02eaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+12:3645:x1876403964504576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478617.834808:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc02eaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+12:3645:x1876403964504576:12345-0@lo:400:kworker.0 Request processed in 46us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478617.834816:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789478617.834851:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964505088 00000100:00100000:2.0:1789478617.834855:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964505088 00000100:00100000:2.0:1789478617.835983:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789478617.835995:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964505088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478617.836724:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964504704:0@lo:38:kworker.0 00000100:00100000:0.0:1789478617.837132:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478617.837171:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964504832:0@lo:8:kworker.0 00000400:00000100:0.0:1789478617.837195:0:3644:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876403964504832 offset 0 length 520: 4 00000100:00100000:0.0:1789478617.837218:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964504960:0@lo:8:kworker.0 00000400:00000100:0.0:1789478617.837234:0:3644:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876403964504960 offset 0 length 520: 4 00000100:00100000:3.0:1789478617.838634:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964504704 00000100:00100000:3.0:1789478617.838647:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964504704 00000100:00100000:3.0:1789478617.838690:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789478617.838698:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876403964504704:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789478617.838719:0:17243:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789478617.845458:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964505088:12345-0@lo:400:kworker.0 Request processed in 9457us (10803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478617.845473:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789478617.845537:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ebc34cb7800 x1876403964505088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478617.845551:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964505088:0@lo:400:kworker.0 00000100:00100000:2.0:1789478617.845562:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d53a32c3-7c45-4781-893e-f633d5432f2d:3645:1876403964504576:0@lo:400:kworker.0 00000100:00100000:1.0:1789478617.857046:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876403964504704:12345-0@lo:38:kworker.0 Request processed in 18341us (19907us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789478617.857059:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789478617.858445:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc3f6c1000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789478617.858455:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789478617.858459:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964504704:0@lo:38:kworker.0 00010000:00010000:3.0:1789478618.341059:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478618.726492:0:17280:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f29c0 going to sleep for 0 seconds 00010000:00010000:2.0:1789478619.366105:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478619.749498:0:17280:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f29c0 going to sleep for 0 seconds 00000040:00080000:2.0:1789478619.814193:0:17274:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1789478620.251015:0:17970:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789478620.251019:0:17970:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789478620.251020:0:17970:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789478620.251137:0:17970:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ebc35b1c000 00000020:01000004:2.0:1789478620.251152:0:17970:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1789478620.251163:0:17970:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789478620.251175:0:17970:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8ebc0658cd28) 00000020:00000080:2.0:1789478620.251191:0:17970:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789478620.302163:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789478620.303322:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1789478620.305036:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789478620.305238:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1789478620.305668:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789478620.305916:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1789478620.306198:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789478620.306506:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789478620.306725:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1789478620.307001:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1789478620.307252:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1789478620.307553:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789478620.307851:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789478620.308199:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1789478620.308568:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789478620.308775:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1789478620.309065:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1789478620.309271:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1789478620.309543:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789478620.309755:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1789478620.310061:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1789478620.310544:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1789478620.311002:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1789478620.311222:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1789478620.311553:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1789478620.311883:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1789478620.312169:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789478620.312730:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789478620.313018:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789478620.313226:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789478620.313547:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789478620.313820:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1789478620.314095:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1789478620.314518:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789478620.317121:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789478620.317747:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789478620.318058:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789478620.318287:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789478620.318673:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1789478620.318999:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789478620.319241:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789478620.319644:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789478620.319843:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1789478620.320137:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1789478620.320396:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789478620.320845:0:17970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1789478620.322190:0:17970:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789478620.322650:0:17970:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789478620.322661:0:17970:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789478620.322672:0:17970:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8ebaae74e8216fbd 00000020:01000004:3.0:1789478620.322680:0:17970:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789478620.322699:0:17970:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.111@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789478620.322702:0:17970:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789478620.322708:0:17970:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789478620.322732:0:17970:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789478620.322736:0:17970:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.111@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789478620.331380:0:17970:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789478620.331446:0:17970:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.111@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1789478620.331450:0:17970:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789478620.331452:0:17970:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789478620.331453:0:17970:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478620.331455:0:17970:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478620.331456:0:17970:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478620.331458:0:17970:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478620.331459:0:17970:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789478620.331461:0:17970:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478620.331463:0:17970:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789478620.331467:0:17970:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1789478620.331469:0:17970:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789478620.331471:0:17970:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789478620.331472:0:17970:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478620.331473:0:17970:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478620.331474:0:17970:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478620.331475:0:17970:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478620.331476:0:17970:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789478620.331478:0:17970:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478620.331479:0:17970:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789478620.331504:0:17970:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789478620.331523:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964505216:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789478620.331585:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478620.331658:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03cd7480 going to sleep for 11 seconds 00000100:00100000:3.0:1789478620.331724:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964505216 00000100:00100000:3.0:1789478620.331734:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964505216 00000100:00100000:3.0:1789478620.331791:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789478620.331800:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc1a62f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+12:17970:x1876403964505216:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789478620.331826:0:17233:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789478620.331829:0:17233:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1789478620.331836:0:17233:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789478620.332370:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc1a62f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+12:17970:x1876403964505216:12345-0@lo:253:mount.lustre.0 Request processed in 568us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478620.332388:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789478620.332660:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964505216:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789478620.332670:0:17970:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789478620.332673:0:17970:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789478620.332674:0:17970:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789478620.332675:0:17970:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478620.332682:0:17970:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478620.332683:0:17970:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478620.332684:0:17970:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478620.332685:0:17970:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789478620.332686:0:17970:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478620.332687:0:17970:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789478620.332703:0:17970:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ebc35b1c000 from lustre-MDT0001 10000000:01000000:2.0:1789478620.332730:0:17970:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789478620.332732:0:17970:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789478620.332738:0:17970:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ebc40f719b8 local copy 00010000:00010000:2.0:1789478620.332747:0:17970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216eb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216eba expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478620.332832:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964505344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789478620.332859:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478620.332891:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03cd73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478620.332953:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964505344 00000100:00100000:0.0:1789478620.332959:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964505344 00000100:00100000:0.0:1789478620.332991:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789478620.332998:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc1a62fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+12:17970:x1876403964505344:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789478620.333073:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc1a62fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+12:17970:x1876403964505344:12345-0@lo:501:mount.lustre.0 Request processed in 75us (212us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789478620.333079:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789478620.333210:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964505344:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789478620.333223:0:17970:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789478620.333238:0:17970:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789478620.333243:0:17970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216eb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216eba expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478620.333251:0:17970:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216eba expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478620.333271:0:17970:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ebc35b1c000 10000000:01000000:2.0:1789478620.333275:0:17970:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789478620.333279:0:17970:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8ebc40f719b8 10000000:01000000:2.0:1789478620.333282:0:17970:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789478620.333296:0:17970:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8ebc40f719b8 from 1 10000000:01000000:2.0:1789478620.333299:0:17970:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789478620.333327:0:17970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8216fc4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478620.333334:0:17970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8216fc4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478620.333343:0:17970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8216fc4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478620.333355:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964505472:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789478620.333391:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478620.333418:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03cd73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478620.333654:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964505472 00000100:00100000:0.0:1789478620.333659:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964505472 00000100:00100000:0.0:1789478620.333694:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789478620.333701:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+12:17970:x1876403964505472:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789478620.333719:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478620.333731:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc029de200/0x8ebaae74e8216fcb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8216fc4 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.333750:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc029de200/0x8ebaae74e8216fcb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8216fc4 expref: 13 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.333760:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc029de200/0x8ebaae74e8216fcb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8216fc4 expref: 13 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.333768:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029de200, rc 0) 00000100:00100000:0.0:1789478620.333808:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+13:17970:x1876403964505472:12345-0@lo:101:mount.lustre.0 Request processed in 107us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478620.333814:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789478620.334016:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964505472:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789478620.334029:0:17970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8216fc4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216fcb expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478620.334038:0:17970:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8216fc4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8216fcb expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478620.334052:0:17970:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789478620.334073:0:17970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8216fc4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216fcb expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478620.334080:0:17970:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77a00/0x8ebaae74e8216fc4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216fcb expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478620.334087:0:17970:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ebc35b1c000 10000000:01000000:2.0:1789478620.334091:0:17970:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789478620.334094:0:17970:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ebc35b1c000 from 1 10000000:01000000:2.0:1789478620.334101:0:17970:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789478620.334116:0:17970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8216fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478620.334122:0:17970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8216fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478620.334130:0:17970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8216fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478620.334141:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964505600:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789478620.334165:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478620.334190:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03cd73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478620.334252:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964505600 00000100:00100000:0.0:1789478620.334256:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964505600 00000100:00100000:0.0:1789478620.334290:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789478620.334296:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+13:17970:x1876403964505600:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789478620.334303:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478620.334311:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc029de800/0x8ebaae74e8216fd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8216fd2 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.334323:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc029de800/0x8ebaae74e8216fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8216fd2 expref: 14 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.334332:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc029de800/0x8ebaae74e8216fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8216fd2 expref: 14 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.334338:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029de800, rc 0) 00000100:00100000:0.0:1789478620.334383:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+14:17970:x1876403964505600:12345-0@lo:101:mount.lustre.0 Request processed in 87us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478620.334389:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789478620.334729:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964505600:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789478620.334742:0:17970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8216fd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216fd9 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478620.334750:0:17970:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8216fd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8216fd9 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478620.334760:0:17970:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789478620.334774:0:17970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8216fd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216fd9 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478620.334791:0:17970:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76600/0x8ebaae74e8216fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216fd9 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478620.334797:0:17970:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789478620.334801:0:17970:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789478620.334813:0:17970:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ebc35b1c000 10000000:01000000:2.0:1789478620.334815:0:17970:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789478620.334819:0:17970:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789478620.334821:0:17970:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789478620.334837:0:17970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77400/0x8ebaae74e8216fe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478620.334844:0:17970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77400/0x8ebaae74e8216fe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478620.334851:0:17970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77400/0x8ebaae74e8216fe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478620.334863:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964505728:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789478620.334890:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478620.335012:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03cd73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478620.335058:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964505728 00000100:00100000:0.0:1789478620.335062:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964505728 00000100:00100000:0.0:1789478620.335097:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789478620.335104:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+14:17970:x1876403964505728:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789478620.335112:0:17232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478620.335122:0:17232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc029de600/0x8ebaae74e8216fe7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8216fe0 expref: -99 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.335137:0:17232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc029de600/0x8ebaae74e8216fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8216fe0 expref: 15 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.335145:0:17232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc029de600/0x8ebaae74e8216fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8216fe0 expref: 15 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.335151:0:17232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc029de600, rc 0) 00000100:00100000:0.0:1789478620.335250:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+15:17970:x1876403964505728:12345-0@lo:101:mount.lustre.0 Request processed in 146us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478620.335257:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789478620.335707:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964505728:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789478620.335722:0:17970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77400/0x8ebaae74e8216fe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216fe7 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478620.335730:0:17970:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77400/0x8ebaae74e8216fe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8216fe7 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789478620.336909:0:17970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1789478620.337723:0:17970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789478620.342168:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789478620.342215:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1789478620.342228:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1789478620.342240:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1789478620.342253:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1789478620.342267:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1789478620.342279:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1789478620.342303:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1789478620.342316:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1789478620.342328:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1789478620.342340:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1789478620.342351:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1789478620.342371:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1789478620.342385:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1789478620.342396:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1789478620.342408:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1789478620.342420:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1789478620.342814:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1789478620.342832:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1789478620.342848:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1789478620.342874:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1789478620.342888:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1789478620.342900:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1789478620.342997:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1789478620.343005:0:17970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1789478620.343096:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964505856:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789478620.343148:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478620.343221:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc104fe180 going to sleep for 11 seconds 00000100:00100000:2.0:1789478620.343257:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964505856 00000100:00100000:2.0:1789478620.343263:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964505856 00000100:00100000:2.0:1789478620.343404:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789478620.343413:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+15:17970:x1876403964505856:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789478620.343577:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+15:17970:x1876403964505856:12345-0@lo:501:mount.lustre.0 Request processed in 165us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478620.343585:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789478620.343859:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964505856:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789478620.343891:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964505984:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789478620.343941:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478620.343959:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc104fe180 going to sleep for 11 seconds 00000100:00100000:0.0:1789478620.344008:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964505984 00000100:00100000:0.0:1789478620.344013:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964505984 00000100:00100000:0.0:1789478620.344051:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789478620.344058:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+15:17970:x1876403964505984:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789478620.345231:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+15:17970:x1876403964505984:12345-0@lo:503:mount.lustre.0 Request processed in 1169us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478620.345241:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789478620.345736:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964505984:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789478620.346531:0:17970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789478620.346862:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964506112:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789478620.346935:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478620.346972:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03cd7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789478620.347025:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964506112 00000100:00100000:1.0:1789478620.347032:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964506112 00000100:00100000:1.0:1789478620.347079:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789478620.347089:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+15:17970:x1876403964506112:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789478620.347927:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+15:17970:x1876403964506112:12345-0@lo:502:mount.lustre.0 Request processed in 836us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478620.347937:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789478620.348094:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964506112:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789478620.348354:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789478620.348390:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1789478620.348404:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1789478620.348416:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1789478620.348505:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1789478620.348520:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1789478620.348532:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1789478620.348544:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1789478620.348556:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1789478620.348567:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1789478620.348578:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1789478620.348590:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1789478620.348777:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1789478620.348804:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1789478620.348817:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1789478620.348829:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1789478620.348841:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1789478620.348854:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1789478620.348869:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1789478620.348882:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1789478620.348894:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1789478620.348909:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1789478620.348940:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1789478620.348959:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1789478620.348974:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1789478620.348988:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1789478620.349004:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1789478620.349017:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1789478620.349028:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1789478620.349040:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1789478620.349053:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1789478620.349066:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1789478620.349092:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1789478620.349112:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1789478620.349124:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1789478620.349138:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1789478620.349150:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1789478620.349162:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1789478620.349175:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1789478620.349188:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1789478620.349204:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1789478620.349215:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1789478620.349228:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1789478620.349247:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1789478620.349766:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964506240:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789478620.349850:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478620.349939:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03cd7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789478620.350024:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964506240 00000100:00100000:3.0:1789478620.350030:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964506240 00000100:00100000:3.0:1789478620.350114:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789478620.350124:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+15:17970:x1876403964506240:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789478620.350251:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+15:17970:x1876403964506240:12345-0@lo:502:mount.lustre.0 Request processed in 128us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478620.350258:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789478620.350355:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964506240:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789478620.350582:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1789478620.350615:0:17970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1789478620.351404:0:17974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789478620.351414:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478620.351416:0:17974:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789478620.351421:0:17974:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1789478620.351531:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789478620.351544:0:17974:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8ebc40f74d28) 00000020:00000080:0.0:1789478620.351561:0:17974:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1789478620.351566:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789478620.351657:0:17974:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789478620.351664:0:17974:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8ebaae74e8216ff5 00000020:00000080:0.0:1789478620.351866:0:17974:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789478620.351871:0:17974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789478620.351875:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478620.351876:0:17974:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789478620.351879:0:17974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789478620.351883:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478620.351884:0:17974:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1789478620.351887:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789478620.351894:0:17974:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8ebc40f70000) 00000020:00000080:0.0:1789478620.351904:0:17974:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1789478620.351907:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789478620.351909:0:17974:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1789478620.351912:0:17974:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1789478620.352098:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789478620.352162:0:17974:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ebc35b1c000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1789478620.352176:0:17974:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8ebc08d93370) 00000020:00000080:0.0:1789478620.352191:0:17974:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1789478620.352247:0:17974:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789478620.352252:0:17974:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8ebaae74e821700a 00000020:00000080:0.0:1789478620.352727:0:17974:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1789478620.352735:0:17974:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789478620.352739:0:17974:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x8ebaae74e8217011 00080000:01000000:0.0:1789478620.352746:0:17974:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789478620.352749:0:17974:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8ebaae74e8217018 00010000:00010000:3.0:1789478620.390197:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478620.476386:0:17974:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1789478620.477057:0:17974:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1789478620.477422:0:17974:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789478620.478536:0:17974:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1789478620.478547:0:17974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789478620.478559:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478620.478561:0:17974:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1789478620.478565:0:17974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789478620.478571:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478620.478572:0:17974:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1789478620.478575:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789478620.478580:0:17974:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:00000080:3.0:1789478620.478627:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789478620.478641:0:17974:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8ebc34c70000) 00000020:00000080:3.0:1789478620.478661:0:17974:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1789478620.478667:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789478620.478832:0:17974:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1789478620.478840:0:17974:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789478620.478847:0:17974:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8ebaae74e8217026 00010000:00080000:3.0:1789478620.478878:0:17974:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ebc34e1b800@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.111@tcp at head 00010000:00010000:3.0:1789478620.485256:0:17974:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1789478620.487911:0:17974:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789478620.487927:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789478620.487966:0:17974:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789478620.487987:0:17974:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8ebaae74e821702d 00000100:00080000:3.0:1789478620.487998:0:17974:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789478620.488008:0:17974:0:(import.c:625:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ebc34e1b800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1789478620.489156:0:17974:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb03599500 x1876403964506368/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789478620.489269:0:17974:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1789478620.489359:0:17974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789478620.489365:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478620.489367:0:17974:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1789478620.489371:0:17974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789478620.489374:0:17974:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789478620.489375:0:17974:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789478620.489388:0:17974:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789478620.489389:0:17974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789478620.489393:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478620.489395:0:17974:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789478620.489397:0:17974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789478620.489402:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478620.489404:0:17974:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1789478620.489408:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789478620.489452:0:17974:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789478620.489464:0:17974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789478620.489467:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478620.489468:0:17974:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1789478620.489471:0:17974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000100:00080000:1.0:1789478620.489471:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000020:01000000:3.0:1789478620.489472:0:17974:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1789478620.489483:0:17974:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789478620.489486:0:17974:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789478620.489487:0:17974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000100:00080000:1.0:1789478620.489487:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000020:00000080:3.0:1789478620.489490:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00080000:1.0:1789478620.489490:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ebc3f6c1000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000020:00000080:3.0:1789478620.489491:0:17974:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789478620.489493:0:17974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789478620.489497:0:17974:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789478620.489500:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00080000:1.0:1789478620.489500:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 446 00000020:00000080:3.0:1789478620.489501:0:17974:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789478620.489504:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000100:00080000:1.0:1789478620.489504:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000020:00000080:3.0:1789478620.489508:0:17974:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000100:00080000:1.0:1789478620.489513:0:37:0:(import.c:625:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ebc3f6c1000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1789478620.489537:0:37:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb037e4700 x1876403964506496/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789478620.489547:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789478620.489550:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789478620.489552:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789478620.489554:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789478620.489633:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964506624:0@lo:400:kworker.0 00000100:00100000:1.0:1789478620.489706:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478620.489715:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964506368:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789478620.489747:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478620.489749:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964506624 00000100:00100000:1.0:1789478620.489754:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964506624 00000100:00100000:0.0:1789478620.489771:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964506496:0@lo:38:kworker.0 00000100:00100000:0.0:1789478620.489806:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478620.489834:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964506368 00000100:00100000:0.0:1789478620.489838:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964506368 00000100:00100000:0.0:1789478620.489852:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964506496 00000100:00100000:0.0:1789478620.489854:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964506496 00000100:00100000:0.0:1789478620.489866:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789478620.489873:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876403964506368:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789478620.489894:0:17244:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:0.0:1789478620.489927:0:17244:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8ebaae74e8217034 00000100:00100000:1.0:1789478620.489929:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789478620.489936:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964506624:12345-0@lo:400:kworker.0 00000004:00100000:0.0:1789478620.489940:0:17244:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789478620.489944:0:17244:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1789478620.489978:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964506624:12345-0@lo:400:kworker.0 Request processed in 43us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478620.489985:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789478620.490016:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ebb037e7b80 x1876403964506624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478620.490029:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964506624:0@lo:400:kworker.0 00000020:01000000:3.0:1789478620.490351:0:17974:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789478620.490355:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789478620.490368:0:17974:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8ebc34c73370) 00000020:00000080:3.0:1789478620.490384:0:17974:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1789478620.490390:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789478620.490469:0:17974:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1789478620.490484:0:17974:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789478620.490492:0:17974:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8ebaae74e8217042 00010000:00080000:3.0:1789478620.490540:0:17974:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ebc34e1f800@lustre-OST0000-osc-MDT0001: add connection 192.168.206.111@tcp at head 00010000:00010000:3.0:1789478620.490794:0:17974:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:3.0:1789478620.494295:0:17974:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789478620.494626:0:17974:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789478620.502471:0:17974:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1789478620.502862:0:17244:0:(import.c:65:import_set_state_nolock()) ffff8ebc03eec000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789478620.502967:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1876403964506368:12345-0@lo:38:llog_process_th.0 Request processed in 13090us (13215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478620.502981:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789478620.503012:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789478620.503020:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876403964506496:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1789478620.503049:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789478620.503060:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00100000:2.0:1789478620.503065:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876403964506496:12345-0@lo:38:kworker.0 Request processed in 43us (13256us total) trans 0 rc -11/-11 00000100:00080000:0.0:1789478620.503069:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00100000:2.0:1789478620.503075:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789478620.503077:0:3644:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789478620.503082:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc34e1b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789478620.503102:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964506368:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789478620.503118:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789478620.503122:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc3f6c1000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789478620.503133:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789478620.503137:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964506496:0@lo:38:kworker.0 00000100:00100000:2.0:1789478620.503353:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964506752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789478620.503395:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478620.503538:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964506752 00000100:00100000:0.0:1789478620.503545:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964506752 00000100:00100000:0.0:1789478620.503585:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789478620.503613:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1876403964506752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789478620.503638:0:17243:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789478620.503701:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1876403964506752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478620.503707:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789478620.504149:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964506752:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1789478620.504559:0:17974:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789478620.504765:0:17974:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:3.0:1789478620.505819:0:17979:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789478620.505825:0:17979:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789478620.506874:0:17974:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789478620.506894:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789478620.506936:0:17974:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789478620.506959:0:17974:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8ebaae74e8217049 00000100:00080000:1.0:1789478620.506970:0:17974:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789478620.506980:0:17974:0:(import.c:625:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ebc34e1f800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1789478620.507012:0:17974:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb037e7b80 x1876403964506880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789478620.507031:0:17974:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789478620.507111:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789478620.507117:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789478620.507125:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789478620.507128:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789478620.507151:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964506880:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789478620.507221:0:3644:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876403964506880 offset 0 length 520: 4 00000020:01000000:1.0:1789478620.507338:0:17974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789478620.507342:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478620.507344:0:17974:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789478620.507347:0:17974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789478620.507349:0:17974:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1789478620.507351:0:17974:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789478620.507352:0:17974:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789478620.507354:0:17974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789478620.507356:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478620.507357:0:17974:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789478620.507359:0:17974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789478620.507363:0:17974:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789478620.507367:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478620.507368:0:17974:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789478620.507371:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789478620.507375:0:17974:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:01000000:1.0:1789478620.507395:0:17974:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789478620.507397:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789478620.507409:0:17974:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8ebc3f7319b8) 00000020:00000080:1.0:1789478620.507422:0:17974:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1789478620.507427:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789478620.507489:0:17974:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1789478620.507495:0:17974:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789478620.507510:0:17974:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8ebaae74e8217057 00010000:00080000:1.0:1789478620.507540:0:17974:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ebc1897e000@lustre-OST0001-osc-MDT0001: add connection 192.168.206.111@tcp at head 00010000:00010000:1.0:1789478620.507826:0:17974:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1789478620.507891:0:17974:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789478620.507904:0:17974:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789478620.511714:0:17974:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789478620.512052:0:17974:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789478620.512363:0:17974:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789478620.515157:0:17981:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789478620.515166:0:17981:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789478620.516405:0:17974:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789478620.516418:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789478620.516460:0:17974:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789478620.516481:0:17974:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8ebaae74e821705e 00000100:00080000:3.0:1789478620.516491:0:17974:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789478620.516502:0:17974:0:(import.c:625:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ebc1897e000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1789478620.516535:0:17974:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb03599f80 x1876403964507008/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789478620.516553:0:17974:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789478620.516644:0:17974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:2.0:1789478620.516647:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:00000080:3.0:1789478620.516649:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478620.516652:0:17974:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000100:00080000:2.0:1789478620.516655:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1789478620.516657:0:17974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00080000:2.0:1789478620.516659:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:00000080:3.0:1789478620.516663:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00080000:2.0:1789478620.516665:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:3.0:1789478620.516666:0:17974:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789478620.516671:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789478620.516673:0:17974:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789478620.516676:0:17974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789478620.516678:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478620.516687:0:17974:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789478620.516691:0:17974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789478620.516693:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478620.516694:0:17974:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789478620.516698:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789478620.516722:0:17974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789478620.516726:0:17974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478620.516727:0:17974:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789478620.516731:0:17974:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1789478620.516812:0:17970:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1789478620.516851:0:17970:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789478620.516871:0:17970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77400/0x8ebaae74e8216fe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216fe7 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478620.516882:0:17970:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77400/0x8ebaae74e8216fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216fe7 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478620.516890:0:17970:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ebc35b1c000 from 1 10000000:01000000:2.0:1789478620.516893:0:17970:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789478620.516930:0:17970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76200/0x8ebaae74e8217065 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478620.517027:0:17970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76200/0x8ebaae74e8217065 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478620.517041:0:17970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76200/0x8ebaae74e8217065 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478620.517062:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964507136:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789478620.517123:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478620.517175:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc094f90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478620.517403:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964507136 00000100:00100000:1.0:1789478620.517410:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964507136 00000100:00100000:1.0:1789478620.517462:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789478620.517471:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+15:17970:x1876403964507136:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789478620.517483:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478620.517494:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc08c4b800/0x8ebaae74e821706c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8217065 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478620.517515:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc08c4b800/0x8ebaae74e821706c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8217065 expref: 16 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478620.517524:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc08c4b800/0x8ebaae74e821706c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8217065 expref: 16 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478620.517532:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4b800, rc 0) 00000100:00100000:1.0:1789478620.517585:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+16:17970:x1876403964507136:12345-0@lo:101:mount.lustre.0 Request processed in 115us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478620.517613:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789478620.518490:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964507008:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789478620.518530:0:3644:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876403964507008 offset 0 length 520: 4 00000100:00100000:3.0:1789478620.518774:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964507136:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789478620.518802:0:17970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76200/0x8ebaae74e8217065 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e821706c expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478620.518812:0:17970:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76200/0x8ebaae74e8217065 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e821706c expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478620.519433:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964507264:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789478620.519475:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478620.519512:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb032010c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478620.520237:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964507264 00000100:00100000:2.0:1789478620.520244:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964507264 00000100:00100000:2.0:1789478620.520431:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789478620.520440:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+16:17970:x1876403964507264:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789478620.520461:0:17233:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789478620.520481:0:17233:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789478620.520484:0:17233:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789478620.520586:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+16:17970:x1876403964507264:12345-0@lo:256:mount.lustre.0 Request processed in 146us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478620.520619:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789478620.520718:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964507264:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789478620.521345:0:17970:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789478620.521365:0:17970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76200/0x8ebaae74e8217065 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e821706c expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478620.521377:0:17970:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76200/0x8ebaae74e8217065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e821706c expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478620.521384:0:17970:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebc35b1c000 from 1 10000000:01000000:3.0:1789478620.521386:0:17970:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789478620.521423:0:17970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd600/0x8ebaae74e8217073 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478620.521431:0:17970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd600/0x8ebaae74e8217073 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478620.521440:0:17970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd600/0x8ebaae74e8217073 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478620.521457:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964507392:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789478620.521498:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478620.527729:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb032010c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478620.527855:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964507392 00000100:00100000:1.0:1789478620.527865:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964507392 00000100:00100000:1.0:1789478620.527915:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789478620.527924:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+16:17970:x1876403964507392:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789478620.527955:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478620.527973:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc08c4b200/0x8ebaae74e821707a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8217073 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478620.528001:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc08c4b200/0x8ebaae74e821707a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8217073 expref: 17 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478620.528012:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc08c4b200/0x8ebaae74e821707a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8217073 expref: 17 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478620.528022:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4b200, rc 0) 00000100:00100000:1.0:1789478620.528091:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+17:17970:x1876403964507392:12345-0@lo:101:mount.lustre.0 Request processed in 169us (6592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478620.528098:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789478620.528193:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964507392:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789478620.528223:0:17970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd600/0x8ebaae74e8217073 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e821707a expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478620.528233:0:17970:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd600/0x8ebaae74e8217073 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e821707a expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789478620.528375:0:17970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789478620.528413:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964507520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789478620.528444:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478620.528469:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc104fec00 going to sleep for 11 seconds 00000100:00100000:1.0:1789478620.528573:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964507520 00000100:00100000:1.0:1789478620.528579:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964507520 00000100:00100000:1.0:1789478620.528634:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789478620.528642:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+17:17970:x1876403964507520:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789478620.528724:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+17:17970:x1876403964507520:12345-0@lo:501:mount.lustre.0 Request processed in 83us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478620.528732:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789478620.529107:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964507520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789478620.529136:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964507648:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789478620.529200:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478620.529229:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc104fec00 going to sleep for 11 seconds 00000100:00100000:1.0:1789478620.529274:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964507648 00000100:00100000:1.0:1789478620.529280:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964507648 00000100:00100000:1.0:1789478620.529322:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789478620.529329:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+17:17970:x1876403964507648:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789478620.529418:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+17:17970:x1876403964507648:12345-0@lo:503:mount.lustre.0 Request processed in 89us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478620.529437:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789478620.529635:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964507648:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789478620.529977:0:17970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789478620.530043:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964507776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789478620.530082:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478620.530109:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc011caa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789478620.530359:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964507776 00000100:00100000:1.0:1789478620.530364:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964507776 00000100:00100000:1.0:1789478620.530398:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789478620.530406:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+17:17970:x1876403964507776:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789478620.530497:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+17:17970:x1876403964507776:12345-0@lo:502:mount.lustre.0 Request processed in 91us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478620.530504:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789478620.530648:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964507776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789478620.530843:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789478620.530870:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1789478620.530885:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1789478620.530897:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1789478620.530913:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1789478620.530926:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1789478620.530938:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1789478620.530950:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1789478620.530964:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789478620.530977:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1789478620.530991:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1789478620.531014:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964507904:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789478620.531051:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478620.531075:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc011caa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789478620.532105:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964507904 00000100:00100000:0.0:1789478620.532115:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964507904 00000100:00100000:0.0:1789478620.532175:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789478620.532185:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+17:17970:x1876403964507904:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789478620.532969:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+17:17970:x1876403964507904:12345-0@lo:502:mount.lustre.0 Request processed in 783us (1913us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478620.532979:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789478620.533056:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964507904:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789478620.533130:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1789478620.533142:0:17970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789478620.538338:0:17983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789478620.538354:0:17983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478620.538357:0:17983:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789478620.538364:0:17983:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ebc35b1c000 00000020:00000080:1.0:1789478620.538367:0:17983:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789478620.538375:0:17983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789478620.538378:0:17983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478620.538380:0:17983:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789478620.538382:0:17983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789478620.538384:0:17983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478620.538386:0:17983:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789478620.538389:0:17983:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ebc35b1c000 00000020:00000080:1.0:1789478620.538391:0:17983:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789478620.538455:0:17983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789478620.538459:0:17983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478620.538460:0:17983:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789478620.538462:0:17983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789478620.538465:0:17983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478620.538466:0:17983:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789478620.538469:0:17983:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ebc35b1c000 00000020:00000080:1.0:1789478620.538471:0:17983:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789478620.538488:0:17983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789478620.538496:0:17983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478620.538497:0:17983:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789478620.538500:0:17983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789478620.538502:0:17983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478620.538503:0:17983:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789478620.538507:0:17983:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ebc35b1c000 00000020:00000080:1.0:1789478620.538508:0:17983:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789478620.538537:0:17983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789478620.538540:0:17983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478620.538542:0:17983:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789478620.538545:0:17983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1789478620.538797:0:17970:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789478620.538832:0:17970:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789478620.538860:0:17970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd600/0x8ebaae74e8217073 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e821707a expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.538871:0:17970:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd600/0x8ebaae74e8217073 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e821707a expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478620.538916:0:17970:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789478620.538920:0:17970:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ebc35b1c000 10000000:01000000:0.0:1789478620.538923:0:17970:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ebc35b1c000 10000000:01000000:0.0:1789478620.538927:0:17970:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789478620.538933:0:17970:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ebc35b1c000 from 1 10000000:01000000:0.0:1789478620.538936:0:17970:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789478620.538968:0:17970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc029df600/0x8ebaae74e8217081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.538977:0:17970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc029df600/0x8ebaae74e8217081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.538986:0:17970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc029df600/0x8ebaae74e8217081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478620.539009:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fedf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964508032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789478620.539072:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478620.539120:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0355ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789478620.549891:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964508032 00000100:00100000:3.0:1789478620.549904:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964508032 00000100:00100000:3.0:1789478620.549960:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789478620.549971:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+17:17970:x1876403964508032:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789478620.549985:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478620.550002:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebb035fd400/0x8ebaae74e8217088 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8217081 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478620.550029:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebb035fd400/0x8ebaae74e8217088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8217081 expref: 18 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478620.550051:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebb035fd400/0x8ebaae74e8217088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8217081 expref: 18 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478620.550061:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fd400, rc 0) 00000100:00100000:3.0:1789478620.550127:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+18:17970:x1876403964508032:12345-0@lo:101:mount.lustre.0 Request processed in 159us (11055us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478620.550134:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789478620.552675:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fedf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964508032:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789478620.552705:0:17970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc029df600/0x8ebaae74e8217081 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217088 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.552719:0:17970:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc029df600/0x8ebaae74e8217081 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8217088 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789478620.562998:0:17970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1789478620.563330:0:17970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789478620.563573:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1789478620.563638:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1789478620.563663:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1789478620.563684:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1789478620.563698:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1789478620.563711:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1789478620.563723:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1789478620.563736:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1789478620.563747:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1789478620.563760:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1789478620.563773:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1789478620.563803:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1789478620.563817:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1789478620.563832:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1789478620.563844:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1789478620.563875:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1789478620.563888:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1789478620.563901:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1789478620.563915:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1789478620.563927:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1789478620.563941:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1789478620.563955:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1789478620.563968:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1789478620.563979:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1789478620.563990:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1789478620.564001:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1789478620.564013:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1789478620.564026:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1789478620.564042:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1789478620.564054:0:17970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1789478620.564131:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fedf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964508160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789478620.564193:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478620.564241:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc185ccb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789478620.564367:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964508160 00000100:00100000:1.0:1789478620.564374:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964508160 00000100:00100000:1.0:1789478620.564420:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789478620.564430:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+18:17970:x1876403964508160:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789478620.565613:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+18:17970:x1876403964508160:12345-0@lo:501:mount.lustre.0 Request processed in 1163us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478620.565703:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789478620.567581:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fedf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964508160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789478620.567663:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fedf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964508288:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789478620.567735:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478620.567772:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc185ccb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789478620.567803:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964508288 00000100:00100000:0.0:1789478620.567809:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964508288 00000100:00100000:0.0:1789478620.567861:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789478620.567870:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+18:17970:x1876403964508288:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789478620.567986:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+18:17970:x1876403964508288:12345-0@lo:503:mount.lustre.0 Request processed in 117us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478620.567995:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789478620.568047:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fedf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964508288:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789478620.568458:0:17970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789478620.568536:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fedf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964508416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789478620.568574:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478620.568617:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc185ccb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789478620.571114:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964508416 00000100:00100000:3.0:1789478620.571127:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964508416 00000100:00100000:3.0:1789478620.571287:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789478620.571298:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+18:17970:x1876403964508416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789478620.571482:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+18:17970:x1876403964508416:12345-0@lo:502:mount.lustre.0 Request processed in 184us (2905us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478620.571491:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789478620.571621:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fedf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964508416:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789478620.571852:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789478620.571884:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1789478620.571900:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1789478620.571915:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1789478620.571928:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1789478620.571941:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1789478620.571955:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1789478620.571969:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1789478620.571981:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1789478620.571994:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1789478620.572007:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1789478620.572020:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1789478620.572035:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1789478620.572050:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1789478620.572064:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1789478620.572077:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1789478620.572090:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1789478620.572106:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1789478620.572155:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1789478620.572181:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1789478620.572218:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1789478620.572237:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1789478620.572254:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1789478620.572271:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1789478620.572285:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1789478620.572301:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1789478620.572316:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1789478620.572331:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1789478620.572347:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1789478620.572362:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1789478620.572377:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1789478620.572391:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1789478620.572410:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1789478620.572427:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1789478620.572459:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1789478620.572479:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1789478620.572497:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1789478620.572512:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1789478620.572522:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1789478620.572532:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1789478620.572542:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1789478620.572553:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1789478620.572564:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1789478620.572575:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1789478620.572586:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1789478620.572626:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1789478620.572642:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1789478620.572655:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1789478620.572700:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964508544:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789478620.572758:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478620.573112:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08cff180 going to sleep for 11 seconds 00000100:00100000:0.0:1789478620.573160:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964508544 00000100:00100000:0.0:1789478620.573166:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964508544 00000100:00100000:0.0:1789478620.573220:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789478620.573230:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+18:17970:x1876403964508544:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789478620.573352:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+18:17970:x1876403964508544:12345-0@lo:502:mount.lustre.0 Request processed in 123us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478620.573365:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789478620.573555:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964508544:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789478620.573862:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1789478620.573899:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1789478620.573930:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964508672:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789478620.573968:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478620.574039:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08cff180 going to sleep for 11 seconds 00000100:00100000:0.0:1789478620.574074:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964508672 00000100:00100000:0.0:1789478620.574079:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964508672 00000100:00100000:0.0:1789478620.574144:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789478620.574152:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+18:17970:x1876403964508672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789478620.574257:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+18:17970:x1876403964508672:12345-0@lo:502:mount.lustre.0 Request processed in 106us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478620.574264:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789478620.574329:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964508672:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789478620.574369:0:17970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1789478620.574377:0:17970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789478620.574907:0:17988:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1789478620.574920:0:17988:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8ebc065899b8) 00000020:00000080:2.0:1789478620.574939:0:17988:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1789478620.575016:0:17988:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ebc35b1c000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789478620.575022:0:17988:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ebc35b1c000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789478620.575024:0:17988:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ebc35b1c000 3 00010000:00080000:2.0:1789478620.575051:0:17988:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ebc0501d800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.111@tcp at head 00010000:00010000:2.0:1789478620.576892:0:17988:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1789478620.577067:0:17988:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1789478620.577105:0:17988:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789478620.577116:0:17988:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x8ebaae74e8217096 00000100:00080000:2.0:1789478620.577125:0:17988:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789478620.577134:0:17988:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ebc0501d800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1789478620.584619:0:17988:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebc34cb6a00 x1876403964508800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789478620.584659:0:17988:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789478620.584693:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789478620.584710:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789478620.584712:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789478620.584715:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789478620.584848:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876403964508800:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789478620.587323:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478620.589179:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964508800 00000100:00100000:2.0:1789478620.589191:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964508800 00000100:00100000:2.0:1789478620.589241:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789478620.589248:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876403964508800:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789478620.589274:0:17239:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 449 last 0 00000040:00080000:3.0:1789478620.589838:0:17988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:00000080:2.0:1789478620.589886:0:17239:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x8ebaae74e821709d 00000004:00100000:2.0:1789478620.589904:0:17239:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789478620.590007:0:17239:0:(import.c:65:import_set_state_nolock()) ffff8ebc0501c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789478620.590168:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876403964508800:12345-0@lo:38:llog_process_th.0 Request processed in 918us (2848us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478620.590177:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:2.0:1789478620.590201:0:17970:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789478620.590232:0:17970:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789478620.590517:0:17970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc029df600/0x8ebaae74e8217081 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217088 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478620.590529:0:17970:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc029df600/0x8ebaae74e8217081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217088 expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789478620.590580:0:17970:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789478620.590582:0:17970:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789478620.590584:0:17970:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478620.590585:0:17970:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478620.590587:0:17970:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478620.590589:0:17970:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478620.590611:0:17970:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789478620.590613:0:17970:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478620.590615:0:17970:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789478620.590619:0:17970:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1789478620.590621:0:17970:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789478620.590623:0:17970:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789478620.590624:0:17970:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478620.590625:0:17970:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478620.590626:0:17970:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478620.590627:0:17970:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478620.590629:0:17970:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789478620.590630:0:17970:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478620.590631:0:17970:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789478620.590651:0:17970:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789478620.590669:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964508928:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789478620.590717:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478620.591861:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08cff6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478620.591907:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964508928 00000100:00100000:2.0:1789478620.591915:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964508928 00010000:00080000:0.0:1789478620.592370:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ebc34cb6a00 x1876403964508800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789478630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478620.592382:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789478620.592392:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789478620.592399:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789478620.592404:0:3644:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789478620.592407:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc0501d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789478620.592414:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876403964508800:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789478620.592447:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789478620.592458:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+18:17970:x1876403964508928:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789478620.592489:0:17234:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789478620.592502:0:17234:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1789478620.599649:0:17219:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1789478620.599853:0:17234:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789478620.599872:0:17234:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1789478620.600302:0:17254:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789478620.600308:0:17254:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789478620.600328:0:17254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ebc029df200/0x8ebaae74e82170a4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.600346:0:17254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8216fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8216fa1 expref: 18 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.600353:0:17254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc08c4b800/0x8ebaae74e821706c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8217065 expref: 18 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.600366:0:17254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ebc029df200/0x8ebaae74e82170a4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.600403:0:17254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc08c4b800/0x8ebaae74e821706c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8217065 expref: 18 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.600416:0:17254:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ebc08c4b800/0x8ebaae74e821706c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8217065 expref: 18 pid: 17234 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478620.600430:0:17254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17254:1876403964509056:0@lo:104: 00000100:00100000:0.0:1789478620.600486:0:17254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789478620.600534:0:17254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8216fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8216fa1 expref: 18 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.600541:0:17254:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8216fa8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8216fa1 expref: 18 pid: 17233 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478620.600549:0:17254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fec380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17254:1876403964509184:0@lo:104: 00000100:00100000:0.0:1789478620.600570:0:17254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478620.600586:0:17254:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc185cc240 going to sleep for 11 seconds 00000100:00100000:0.0:1789478620.600703:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964509056 00000100:00100000:0.0:1789478620.600710:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964509056 00000100:00100000:0.0:1789478620.600741:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964509184 00000100:00100000:0.0:1789478620.600744:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964509184 00000100:00100000:0.0:1789478620.600757:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789478620.600765:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d53a32c3-7c45-4781-893e-f633d5432f2d+4:17254:x1876403964509056:12345-0@lo:104: 00010000:00010000:0.0:1789478620.600778:0:17223:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76200/0x8ebaae74e8217065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e821706c expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.600858:0:17223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789478620.600864:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d53a32c3-7c45-4781-893e-f633d5432f2d+4:17254:x1876403964509056:12345-0@lo:104: Request processed in 100us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478620.600871:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789478620.600887:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789478620.600893:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03feca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d53a32c3-7c45-4781-893e-f633d5432f2d+3:17254:x1876403964509184:12345-0@lo:104: 00010000:00010000:0.0:1789478620.600900:0:17223:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77c00/0x8ebaae74e8216fa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8216fa8 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.600931:0:17223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789478620.600937:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03feca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d53a32c3-7c45-4781-893e-f633d5432f2d+3:17254:x1876403964509184:12345-0@lo:104: Request processed in 45us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478620.600943:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789478620.600960:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789478620.600965:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76200/0x8ebaae74e8217065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e821706c expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.600971:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76200 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478620.600974:0:17227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76200/0x8ebaae74e8217065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e821706c expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.600981:0:17227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76200/0x8ebaae74e8217065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e821706c expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478620.600987:0:17227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76200/0x8ebaae74e8217065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e821706c expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478620.600994:0:17227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789478620.601030:0:17227:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76200/0x8ebaae74e8217065 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e821706c expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.601037:0:17227:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478620.601056:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76200/0x8ebaae74e8217065 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e821706c expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.601061:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76200/0x8ebaae74e8217065 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e821706c expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.601073:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789478620.601076:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77c00/0x8ebaae74e8216fa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8216fa8 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.601081:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77c00 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478620.601084:0:17227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77c00/0x8ebaae74e8216fa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8216fa8 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.601091:0:17227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77c00/0x8ebaae74e8216fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8216fa8 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478620.601096:0:17227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77c00/0x8ebaae74e8216fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8216fa8 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478620.601101:0:17227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789478620.601113:0:17227:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77c00/0x8ebaae74e8216fa1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8216fa8 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.601119:0:17227:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478620.601125:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77c00/0x8ebaae74e8216fa1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8216fa8 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.601141:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77c00/0x8ebaae74e8216fa1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8216fa8 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.601154:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478620.601156:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478620.601157:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478620.601335:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478620.601348:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d53a32c3-7c45-4781-893e-f633d5432f2d:3645:1876403964509312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789478620.601384:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478620.601437:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789478620.601444:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d53a32c3-7c45-4781-893e-f633d5432f2d:3645:1876403964509440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789478620.601470:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478620.601515:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964509312 00000100:00100000:2.0:1789478620.601526:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964509312 00010000:00010000:2.0:1789478620.601548:0:17225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc08c4b800/0x8ebaae74e821706c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8217065 expref: 19 pid: 17234 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478620.601571:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964509440 00000100:00100000:2.0:1789478620.601575:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964509440 00010000:00010000:2.0:1789478620.601589:0:17225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8216fa8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8216fa1 expref: 20 pid: 17233 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478620.601623:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789478620.601630:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d53a32c3-7c45-4781-893e-f633d5432f2d+20:3645:x1876403964509312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789478620.601641:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478620.601646:0:17225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc08c4b800/0x8ebaae74e821706c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8217065 expref: 20 pid: 17234 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478620.601656:0:17225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc08c4b800/0x8ebaae74e821706c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8217065 expref: 20 pid: 17234 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478620.601670:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc08c4b800/0x8ebaae74e821706c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8217065 expref: 20 pid: 17234 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478620.601682:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478620.601716:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d53a32c3-7c45-4781-893e-f633d5432f2d+19:3645:x1876403964509312:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478620.601724:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789478620.601742:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789478620.601753:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d53a32c3-7c45-4781-893e-f633d5432f2d+18:3645:x1876403964509440:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789478620.601754:0:17225:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789478620.601765:0:17225:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1789478620.601766:0:17224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478620.601773:0:17224:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8216fa8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8216fa1 expref: 18 pid: 17233 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478620.601795:0:17224:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8216fa8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8216fa1 expref: 18 pid: 17233 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478620.601805:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d53a32c3-7c45-4781-893e-f633d5432f2d:3645:1876403964509312:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789478620.601809:0:17224:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ebc029df200/0x8ebaae74e82170a4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478620.601827:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc029df200/0x8ebaae74e82170a4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789478620.601840:0:17224:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009990423s 00010000:00010000:3.0:1789478620.601844:0:17224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc029df200/0x8ebaae74e82170a4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478620.601850:0:17224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc029df200/0x8ebaae74e82170a4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478620.601857:0:17224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ebc029df200/0x8ebaae74e82170a4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478620.601863:0:17224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ebc029df200/0x8ebaae74e82170a4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478620.601869:0:17224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029df200 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478620.601873:0:17224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ebc029df200/0x8ebaae74e82170a4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478620.601880:0:17224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ebc029df200/0x8ebaae74e82170a4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478620.601889:0:17224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ebc029df200/0x8ebaae74e82170a4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478620.601899:0:17224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478620.601944:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d53a32c3-7c45-4781-893e-f633d5432f2d+18:3645:x1876403964509440:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478620.601951:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d53a32c3-7c45-4781-893e-f633d5432f2d:3645:1876403964509440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789478620.601955:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789478620.602301:0:17254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17254:1876403964509056:0@lo:104: 00010000:00010000:0.0:1789478620.602321:0:17254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8216fa8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8216fa1 expref: 17 pid: 17233 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478620.602332:0:17254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fec380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17254:1876403964509184:0@lo:104: 00010000:00010000:0.0:1789478620.602346:0:17254:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ebc029df200/0x8ebaae74e82170a4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.602353:0:17254:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ebc029df200/0x8ebaae74e82170a4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.602359:0:17254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ebc029df200/0x8ebaae74e82170a4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478620.602365:0:17254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc029df200/0x8ebaae74e82170a4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478620.603399:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+16:17970:x1876403964508928:12345-0@lo:253:mount.lustre.0 Request processed in 10939us (12677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478620.603410:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789478620.603954:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:17970:1876403964508928:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789478620.603967:0:17970:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789478620.603970:0:17970:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789478620.603971:0:17970:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789478620.603973:0:17970:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789478620.603974:0:17970:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789478620.603975:0:17970:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789478620.603976:0:17970:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789478620.603977:0:17970:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789478620.603979:0:17970:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789478620.603981:0:17970:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789478620.603992:0:17970:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:0.0:1789478620.619546:0:17970:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1789478620.620166:0:17996:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1789478620.620672:0:17996:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1789478620.622823:0:17970:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1789478620.623575:0:17997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e5500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17997:1876403964509568:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789478620.623671:0:17997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478620.623704:0:17997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02afb240 going to sleep for 11 seconds 00000040:01000000:2.0:1789478620.623975:0:17970:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1789478620.624023:0:17970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789478620.624443:0:17970:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789478620.624452:0:17970:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1789478620.624489:0:17970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789478620.625877:0:17996:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789478620.625952:0:17996:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1789478620.625997:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964509568 00000100:00100000:0.0:1789478620.626006:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964509568 00000100:00100000:0.0:1789478620.626067:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789478620.626077:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17997:x1876403964509568:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789478620.626182:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17997:x1876403964509568:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 106us (2511us total) trans 0 rc 0/0 00000040:00080000:2.0:1789478620.626585:0:17970:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000020:00080000:3.0:1789478620.626726:0:17995:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789478620.626731:0:17995:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:1.0:1789478620.626849:0:17997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e5500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17997:1876403964509568:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1789478620.626887:0:17997:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789478620.626928:0:17997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e5500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17997:1876403964509696:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789478620.626970:0:17997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478620.627047:0:17997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02afb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478620.627124:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789478620.627143:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964509696 00000100:00100000:0.0:1789478620.627147:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964509696 00000040:00080000:2.0:1789478620.627753:0:17970:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789478620.627793:0:17970:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1789478620.627890:0:17970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789478620.628563:0:17970:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:0.0:1789478620.629748:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789478620.629764:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17997:x1876403964509696:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789478620.629941:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17997:x1876403964509696:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 182us (2970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478620.629950:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789478620.630139:0:17997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e5500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17997:1876403964509696:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789478620.630344:0:17997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e5500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17997:1876403964509824:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789478620.630382:0:17997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478620.630416:0:17997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02afb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478620.630451:0:17249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964509824 00000100:00100000:0.0:1789478620.630458:0:17249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964509824 00000100:00100000:0.0:1789478620.630496:0:17249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789478620.630503:0:17249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17997:x1876403964509824:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789478620.630541:0:17249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17997:x1876403964509824:12345-0@lo:900:lod0001_rec0000.0 Request processed in 39us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478620.630548:0:17249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789478620.630713:0:17997:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ebb037e5500 x1876403964509824/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789478636 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478620.630724:0:17997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e5500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17997:1876403964509824:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789478620.630770:0:17997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e5500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17997:1876403964509952:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789478620.630810:0:17997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478620.630834:0:17997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02afb240 going to sleep for 11 seconds 00000100:00100000:0.0:1789478620.630954:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964509952 00000100:00100000:0.0:1789478620.630960:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964509952 00000100:00100000:0.0:1789478620.630979:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789478620.630984:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17997:x1876403964509952:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789478620.631069:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17997:x1876403964509952:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 84us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478620.631075:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000001:00000004:2.0:1789478620.631921:0:17970:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1789478620.632117:0:17997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e5500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17997:1876403964509952:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1789478620.632169:0:17997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789478620.635370:0:17997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789478620.635451:0:17997:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789478620.635456:0:17997:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:1.0:1789478620.642046:0:17970:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789478620.642084:0:17970:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9dd90187b988 00100000:10000000:1.0:1789478620.642092:0:17970:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1789478620.643315:0:17970:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789478620.643346:0:17970:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.111@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789478620.643364:0:17970:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789478620.643388:0:17970:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1789478620.651543:0:17970:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789478620.652899:0:17970:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789478620.772752:0:17280:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f29c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789478621.412727:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789478621.608528:0:17992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789478621.797992:0:17280:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f29c0 going to sleep for 0 seconds 10000000:01000000:0.0:1789478622.117942:0:17236:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789478622.117949:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ebc35b1c000 from 8 10000000:01000000:0.0:1789478622.117954:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789478622.118004:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc029df200/0x8ebaae74e82170ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478622.118016:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc029df200/0x8ebaae74e82170ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478622.118027:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc029df200/0x8ebaae74e82170ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478622.118054:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964510080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789478622.118131:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478622.118220:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05297cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478622.122424:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964510080 00000100:00100000:2.0:1789478622.122438:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964510080 00000100:00100000:3.0:1789478622.144502:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789478622.144517:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+16:17236:x1876403964510080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789478622.144534:0:17232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478622.144552:0:17232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebb035fc600/0x8ebaae74e82170b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e82170ab expref: -99 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478622.144578:0:17232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebb035fc600/0x8ebaae74e82170b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e82170ab expref: 17 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478622.144589:0:17232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebb035fc600/0x8ebaae74e82170b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e82170ab expref: 17 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478622.144613:0:17232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fc600, rc 0) 00000100:00100000:3.0:1789478622.144713:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+17:17236:x1876403964510080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (26553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478622.144721:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789478622.144768:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964510080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789478622.144811:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc029df200/0x8ebaae74e82170ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82170b2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478622.144819:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc029df200/0x8ebaae74e82170ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e82170b2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478622.145070:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964510208:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789478622.145110:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478622.145140:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc07a94e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789478622.145155:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964510208 00000100:00100000:3.0:1789478622.145162:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964510208 00000100:00100000:3.0:1789478622.145194:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789478622.145201:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+17:17236:x1876403964510208:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789478622.145214:0:17234:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789478622.145233:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789478622.145236:0:17234:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789478622.145311:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+17:17236:x1876403964510208:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478622.145318:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789478622.145362:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964510208:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789478622.145404:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789478622.145412:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc029df200/0x8ebaae74e82170ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82170b2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478622.145420:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc029df200/0x8ebaae74e82170ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82170b2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478622.145438:0:17236:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789478622.145441:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ebb0372d800 from 8 10000000:01000000:3.0:1789478622.145443:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789478622.145462:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fce00/0x8ebaae74e82170b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478622.145468:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebb035fce00/0x8ebaae74e82170b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478622.145477:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebb035fce00/0x8ebaae74e82170b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478622.145490:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964510336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789478622.145516:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478622.145529:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc07a94e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789478622.145539:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964510336 00000100:00100000:3.0:1789478622.145543:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964510336 00000100:00100000:3.0:1789478622.145562:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789478622.145567:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+17:17236:x1876403964510336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789478622.145573:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478622.145582:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebb035fcc00/0x8ebaae74e82170c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e82170b9 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478622.145618:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebb035fcc00/0x8ebaae74e82170c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e82170b9 expref: 18 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478622.145627:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebb035fcc00/0x8ebaae74e82170c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e82170b9 expref: 18 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478622.145646:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fcc00, rc 0) 00000100:00100000:3.0:1789478622.145674:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+18:17236:x1876403964510336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478622.145680:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789478622.146524:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964510336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789478622.146540:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebb035fce00/0x8ebaae74e82170b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82170c0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478622.146549:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebb035fce00/0x8ebaae74e82170b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e82170c0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478622.146619:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964510464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789478622.146652:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478622.146669:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc07a94e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789478622.146683:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964510464 00000100:00100000:3.0:1789478622.146698:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964510464 00000100:00100000:3.0:1789478622.146721:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789478622.146728:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+18:17236:x1876403964510464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789478622.146741:0:17234:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789478622.146753:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789478622.146756:0:17234:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789478622.146838:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+18:17236:x1876403964510464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478622.146845:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789478622.147094:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964510464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789478622.147141:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789478622.147148:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fce00/0x8ebaae74e82170b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82170c0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478622.147156:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebb035fce00/0x8ebaae74e82170b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82170c0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478622.438573:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789478622.629456:0:17992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789478622.820750:0:17280:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f29c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789478623.460713:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478623.845873:0:17280:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f29c0 going to sleep for 0 seconds 00010000:00010000:1.0:1789478624.484936:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478624.870848:0:17280:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f29c0 going to sleep for 0 seconds 00000100:00100000:2.0:1789478625.510284:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964510592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789478625.510386:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478625.515422:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964510592 00000100:00100000:0.0:1789478625.515512:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964510592 00000100:00100000:0.0:1789478625.515772:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789478625.515783:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964510592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789478625.515820:0:17243:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789478625.515899:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964510592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (5513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478625.515917:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789478625.515934:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964510592:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789478625.515962:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789478625.581052:0:18240:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789478625.892675:0:17280:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f29c0 going to sleep for 0 seconds 00000100:00080000:3.0:1789478626.020879:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789478626.020886:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789478626.020889:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ebc3f6c1000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789478626.020904:0:37:0:(import.c:625:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ebc3f6c1000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1789478626.020926:0:37:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb0359b480 x1876403964510848/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789478626.020933:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d53a32c3-7c45-4781-893e-f633d5432f2d:3648:1876403964510720:0@lo:400:kworker.0 00000100:00080000:3.0:1789478626.020953:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789478626.020958:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789478626.020960:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789478626.020963:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789478626.020993:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789478626.020996:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789478626.020998:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789478626.021000:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789478626.021107:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478626.021178:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789478626.021185:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876403964511232:0@lo:400:kworker.0 00000100:00100000:3.0:1789478626.021219:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964510720 00000100:00100000:3.0:1789478626.021228:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964510720 00000100:00100000:2.0:1789478626.021244:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478626.021281:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964510976:0@lo:400:kworker.0 00000100:00100000:3.0:1789478626.021286:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789478626.021310:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478626.021322:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+18:3648:x1876403964510720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478626.021346:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789478626.021361:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964511104:0@lo:400:kworker.0 00000100:00100000:3.0:1789478626.021389:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+18:3648:x1876403964510720:12345-0@lo:400:kworker.0 Request processed in 69us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478626.021398:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789478626.021409:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478626.021444:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964511232 00000100:00100000:2.0:1789478626.021448:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964511232 00000100:00100000:2.0:1789478626.021473:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964510976 00000100:00100000:2.0:1789478626.021476:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964510976 00000100:00100000:2.0:1789478626.021489:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789478626.021495:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876403964511232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478626.021539:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876403964511232:12345-0@lo:400:kworker.0 Request processed in 44us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478626.021547:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789478626.021562:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789478626.021568:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964510976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478626.021622:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964510976:12345-0@lo:400:kworker.0 Request processed in 54us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478626.021628:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789478626.021647:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964511104 00000100:00100000:2.0:1789478626.021651:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964511104 00000100:00100000:2.0:1789478626.021676:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789478626.021682:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964511104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478626.021713:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964511104:12345-0@lo:400:kworker.0 Request processed in 31us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478626.021719:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789478626.021767:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964511104:0@lo:400:kworker.0 00010000:00080000:2.0:1789478626.021781:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ebb0359b800 x1876403964510976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478626.021790:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964510976:0@lo:400:kworker.0 00010000:00080000:2.0:1789478626.021827:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ebb0359ad80 x1876403964511232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478626.021835:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876403964511232:0@lo:400:kworker.0 00000100:00100000:2.0:1789478626.021843:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d53a32c3-7c45-4781-893e-f633d5432f2d:3648:1876403964510720:0@lo:400:kworker.0 00000100:00100000:1.0:1789478626.022215:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964510848:0@lo:38:kworker.0 00000100:00100000:1.0:1789478626.022251:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478626.022488:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964510848 00000100:00100000:2.0:1789478626.022493:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964510848 00000100:00100000:2.0:1789478626.022533:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789478626.022539:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876403964510848:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789478626.022562:0:17243:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:2.0:1789478626.022615:0:17243:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8ebaae74e82170c7 00000004:00100000:2.0:1789478626.022673:0:17243:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789478626.022679:0:17243:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1789478626.037245:0:17243:0:(import.c:65:import_set_state_nolock()) ffff8ebc40fbb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789478626.037397:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1876403964510848:12345-0@lo:38:kworker.0 Request processed in 14855us (15143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478626.037407:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1789478626.038199:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789478626.038464:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789478626.038469:0:3644:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789478626.038472:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc3f6c1000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789478626.038496:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000911db188): req@ffff8ebb03feea00 x1876403964503808/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478626.042166:0:17280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478626.042203:0:17280:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc095f29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478626.044297:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789478626.044319:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964511360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789478626.044416:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478626.044461:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964503808 00000100:00100000:2.0:1789478626.044468:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964503808 00000100:00100000:2.0:1789478626.044515:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964511360 00000100:00100000:2.0:1789478626.044518:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964511360 00000100:00100000:2.0:1789478626.044532:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789478626.044539:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0359aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17280:x1876403964503808:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789478626.044951:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0359aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17280:x1876403964503808:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 408us (2787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478626.044957:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964510848:0@lo:38:kworker.0 00000100:00100000:2.0:1789478626.044963:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789478626.045202:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789478626.045213:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876403964511360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789478626.045235:0:17243:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789478626.045361:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876403964511360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 150us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478626.045368:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789478626.045532:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964511360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789478626.045941:0:17280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03feea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17280:1876403964503808:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1789478626.046317:0:17280:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789478626.046421:0:17280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17280:1876403964511488:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789478626.046469:0:17280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478626.046521:0:17280:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40dfc6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478626.046976:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964511488 00000100:00100000:2.0:1789478626.046984:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964511488 00000100:00100000:2.0:1789478626.047045:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789478626.047054:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17280:x1876403964511488:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789478626.047299:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17280:x1876403964511488:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 245us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478626.047306:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789478626.049105:0:17280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17280:1876403964511488:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789478626.049201:0:17280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17280:1876403964511616:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789478626.049252:0:17280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478626.049461:0:17280:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40dfc6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478626.050219:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964511616 00000100:00100000:2.0:1789478626.050229:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964511616 00000100:00100000:2.0:1789478626.050528:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789478626.050539:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0359bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17280:x1876403964511616:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789478626.050665:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0359bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17280:x1876403964511616:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 128us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478626.050672:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789478626.050854:0:17280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17280:1876403964511616:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1789478626.050903:0:17280:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789478626.055196:0:17280:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789478626.055267:0:17280:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:3.0:1789478626.055271:0:17280:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:3.0:1789478626.465719:0:18293:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789478626.466152:0:18293:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789478626.535557:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789478627.409229:0:18343:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789478627.410621:0:18343:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789478627.559032:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789478628.487497:0:18391:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff5b6876b0 20000000:00000080:2.0:1789478628.487514:0:18391:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ebc058b4c00 uarg=0000000000000000 20000000:01000000:2.0:1789478628.487550:0:18391:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789478628.487563:0:18391:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789478628.487567:0:18391:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789478628.488295:0:18392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1789478628.488423:0:18391:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789478628.500035:0:18391:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789478628.500065:0:18391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82170ce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478628.500083:0:18391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc08c4b000/0x8ebaae74e8216f77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8216f70 expref: 17 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478628.500091:0:18391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc08c4b200/0x8ebaae74e821707a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8217073 expref: 17 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478628.500098:0:18391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82170ce lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478628.500139:0:18391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc08c4b200/0x8ebaae74e821707a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8217073 expref: 17 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478628.500152:0:18391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ebc08c4b200/0x8ebaae74e821707a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8217073 expref: 17 pid: 17234 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478628.500167:0:18391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18391:1876403964511744:0@lo:104: 00000100:00100000:0.0:1789478628.500227:0:18391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789478628.500289:0:18391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc08c4b000/0x8ebaae74e8216f77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8216f70 expref: 17 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478628.500293:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964511744 00010000:00010000:0.0:1789478628.500297:0:18391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ebc08c4b000/0x8ebaae74e8216f77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8216f70 expref: 17 pid: 17233 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478628.500299:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964511744 00000100:00100000:0.0:1789478628.500321:0:18391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18391:1876403964511872:0@lo:104: 00000100:00100000:0.0:1789478628.500344:0:18391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478628.501075:0:18391:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40dfc900 going to sleep for 11 seconds 00000100:00100000:2.0:1789478628.504392:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964511872 00000100:00100000:2.0:1789478628.504406:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964511872 00000100:00100000:2.0:1789478628.504460:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789478628.504470:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d53a32c3-7c45-4781-893e-f633d5432f2d+4:18391:x1876403964511744:12345-0@lo:104: 00010000:00010000:2.0:1789478628.504491:0:17222:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd600/0x8ebaae74e8217073 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e821707a expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478628.504612:0:17222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789478628.504619:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d53a32c3-7c45-4781-893e-f633d5432f2d+4:18391:x1876403964511744:12345-0@lo:104: Request processed in 151us (4391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478628.504626:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789478628.504643:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789478628.504786:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d53a32c3-7c45-4781-893e-f633d5432f2d+3:18391:x1876403964511872:12345-0@lo:104: 00010000:00010000:2.0:1789478628.504795:0:17222:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77e00/0x8ebaae74e8216f70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8216f77 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478628.504838:0:17222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789478628.504843:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d53a32c3-7c45-4781-893e-f633d5432f2d+3:18391:x1876403964511872:12345-0@lo:104: Request processed in 194us (4499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478628.504849:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789478628.504872:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789478628.504879:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd600/0x8ebaae74e8217073 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e821707a expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478628.504903:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd600 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:2.0:1789478628.504984:0:17227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd600/0x8ebaae74e8217073 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e821707a expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478628.504994:0:17227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd600/0x8ebaae74e8217073 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e821707a expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789478628.505002:0:17227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd600/0x8ebaae74e8217073 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e821707a expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478628.505007:0:17227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789478628.505043:0:17227:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd600/0x8ebaae74e8217073 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e821707a expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478628.505050:0:17227:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789478628.505067:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd600/0x8ebaae74e8217073 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e821707a expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478628.505074:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd600/0x8ebaae74e8217073 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e821707a expref: -99 pid: 17970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478628.505080:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478628.505087:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478628.505088:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478628.505090:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478628.505103:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d53a32c3-7c45-4781-893e-f633d5432f2d:3645:1876403964512000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789478628.505223:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789478628.505268:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478628.505272:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964512000 00010000:00010000:0.0:1789478628.505275:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77e00/0x8ebaae74e8216f70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8216f77 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478628.505277:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964512000 00010000:00010000:0.0:1789478628.505281:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77e00 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478628.505284:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77e00/0x8ebaae74e8216f70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8216f77 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478628.505291:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77e00/0x8ebaae74e8216f70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8216f77 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478628.505294:0:17225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc08c4b200/0x8ebaae74e821707a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8217073 expref: 18 pid: 17234 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478628.505298:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77e00/0x8ebaae74e8216f70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8216f77 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478628.505304:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789478628.505318:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77e00/0x8ebaae74e8216f70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8216f77 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478628.505322:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789478628.505324:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789478628.505328:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d53a32c3-7c45-4781-893e-f633d5432f2d+18:3645:x1876403964512000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789478628.505335:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77e00/0x8ebaae74e8216f70 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8216f77 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478628.505352:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77e00/0x8ebaae74e8216f70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8216f77 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478628.505367:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478628.505374:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478628.505376:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478628.505381:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478628.505382:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478628.505409:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478628.505415:0:17225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc08c4b200/0x8ebaae74e821707a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8217073 expref: 18 pid: 17234 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478628.505425:0:17225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc08c4b200/0x8ebaae74e821707a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8217073 expref: 18 pid: 17234 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478628.505441:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478628.505465:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d53a32c3-7c45-4781-893e-f633d5432f2d+18:3645:x1876403964512000:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478628.505472:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789478628.505490:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d53a32c3-7c45-4781-893e-f633d5432f2d:3646:1876403964512128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789478628.505513:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478628.505560:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d53a32c3-7c45-4781-893e-f633d5432f2d:3645:1876403964512000:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789478628.505649:0:18391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc08c4b200/0x8ebaae74e821707a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8217073 expref: 17 pid: 17234 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478628.505661:0:18391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18391:1876403964511744:0@lo:104: 00000100:00100000:1.0:1789478628.505671:0:18391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18391:1876403964511872:0@lo:104: 00010000:00010000:1.0:1789478628.505687:0:18391:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82170ce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478628.505768:0:17991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964512128 00000100:00100000:0.0:1789478628.505773:0:17991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964512128 00010000:00010000:0.0:1789478628.505791:0:17991:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc08c4b000/0x8ebaae74e8216f77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8216f70 expref: 17 pid: 17233 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478628.505812:0:17991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789478628.505818:0:17991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d53a32c3-7c45-4781-893e-f633d5432f2d+17:3646:x1876403964512128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789478628.505825:0:17991:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478628.505829:0:17991:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc08c4b000/0x8ebaae74e8216f77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8216f70 expref: 17 pid: 17233 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478628.505837:0:17991:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc08c4b000/0x8ebaae74e8216f77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8216f70 expref: 17 pid: 17233 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478628.505846:0:17991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc08c4b000/0x8ebaae74e8216f77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8216f70 expref: 17 pid: 17233 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478628.505858:0:17991:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82170ce lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478628.505865:0:17991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82170ce lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478628.505878:0:17991:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82170ce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478628.505884:0:17991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82170ce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478628.505896:0:17991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82170ce lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478628.505903:0:17991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82170ce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478628.505908:0:17991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40f05a00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:0.0:1789478628.505913:0:17991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82170ce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478628.505920:0:17991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82170ce lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478628.505930:0:17991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82170ce lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478628.505939:0:17991:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478628.505968:0:17991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d53a32c3-7c45-4781-893e-f633d5432f2d+16:3646:x1876403964512128:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (453us total) trans 0 rc 0/0 00010000:00010000:1.0:1789478628.506108:0:18391:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82170ce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478628.506116:0:18391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82170ce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478628.506129:0:18391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82170ce lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478628.506231:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d53a32c3-7c45-4781-893e-f633d5432f2d:3646:1876403964512128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789478628.507142:0:17991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789478628.584464:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789478629.029209:0:17274:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789478629.615671:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789478629.861328:0:17236:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789478629.861336:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebc35b1c000 from 13 10000000:01000000:3.0:1789478629.861342:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789478629.861388:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc800/0x8ebaae74e82170d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478629.861407:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc800/0x8ebaae74e82170d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478629.861418:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc800/0x8ebaae74e82170d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478629.861445:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964512256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789478629.861513:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478629.861558:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03751540 going to sleep for 11 seconds 00000100:00100000:3.0:1789478629.861582:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964512256 00000100:00100000:3.0:1789478629.861588:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964512256 00000100:00100000:3.0:1789478629.861656:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789478629.861666:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+16:17236:x1876403964512256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789478629.861677:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478629.861690:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebb035fda00/0x8ebaae74e82170dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e82170d5 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478629.861713:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebb035fda00/0x8ebaae74e82170dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e82170d5 expref: 17 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478629.861724:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebb035fda00/0x8ebaae74e82170dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e82170d5 expref: 17 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478629.861744:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fda00, rc 0) 00000100:00100000:3.0:1789478629.861783:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+17:17236:x1876403964512256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478629.861790:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789478629.861840:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964512256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789478629.861854:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc800/0x8ebaae74e82170d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82170dc expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478629.861862:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc800/0x8ebaae74e82170d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e82170dc expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478629.861933:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964512384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789478629.861959:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478629.861974:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03751540 going to sleep for 11 seconds 00000100:00100000:3.0:1789478629.861985:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964512384 00000100:00100000:3.0:1789478629.861989:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964512384 00000100:00100000:3.0:1789478629.862010:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789478629.862016:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+17:17236:x1876403964512384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789478629.862122:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+17:17236:x1876403964512384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478629.862128:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789478629.862158:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964512384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789478629.862184:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964512512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789478629.862219:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478629.862233:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03751540 going to sleep for 11 seconds 00000100:00100000:3.0:1789478629.862244:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964512512 00000100:00100000:3.0:1789478629.862247:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964512512 00000100:00100000:3.0:1789478629.862267:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789478629.862272:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+17:17236:x1876403964512512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789478629.862349:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+17:17236:x1876403964512512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478629.862362:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789478629.862402:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964512512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789478629.863084:0:18453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789478629.863142:0:17236:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789478629.863160:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789478629.863168:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc800/0x8ebaae74e82170d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82170dc expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478629.863178:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc800/0x8ebaae74e82170d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82170dc expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478629.863187:0:17236:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789478629.863190:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebb0372d800 from 13 10000000:01000000:3.0:1789478629.863192:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789478629.863216:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e82170e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478629.863223:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e82170e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478629.863232:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e82170e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478629.863249:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964512640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789478629.863285:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478629.863303:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb037516c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478629.863318:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964512640 00000100:00100000:3.0:1789478629.863322:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964512640 00000100:00100000:3.0:1789478629.863361:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789478629.863369:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc38e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+17:17236:x1876403964512640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789478629.863378:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478629.863389:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebb035fd200/0x8ebaae74e82170ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e82170e3 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478629.863406:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebb035fd200/0x8ebaae74e82170ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e82170e3 expref: 18 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478629.863415:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebb035fd200/0x8ebaae74e82170ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e82170e3 expref: 18 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478629.863422:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fd200, rc 0) 00000100:00100000:3.0:1789478629.863452:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc38e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+18:17236:x1876403964512640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478629.863458:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789478629.863494:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964512640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789478629.863506:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e82170e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82170ea expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478629.863514:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e82170e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e82170ea expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478629.863556:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964512768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789478629.863580:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478629.863614:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb037516c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478629.863625:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964512768 00000100:00100000:3.0:1789478629.863629:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964512768 00000100:00100000:3.0:1789478629.863657:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789478629.863664:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc38e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+18:17236:x1876403964512768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789478629.863760:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc38e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+18:17236:x1876403964512768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478629.863766:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789478629.863796:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964512768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789478629.863822:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964512896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789478629.863858:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478629.863871:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb037516c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478629.863882:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964512896 00000100:00100000:3.0:1789478629.863885:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964512896 00000100:00100000:3.0:1789478629.863906:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789478629.863913:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc38e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+18:17236:x1876403964512896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789478629.863980:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc38e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+18:17236:x1876403964512896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478629.863986:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789478629.864027:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964512896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789478629.867582:0:18454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789478629.870030:0:17236:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789478629.870061:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789478629.870072:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e82170e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82170ea expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478629.870084:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e82170e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82170ea expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478630.117224:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789478620/real 1789478620] req@ffff8ebb03599f80 x1876403964507008/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789478630 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478630.117254:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ebb03599f80 x1876403964507008/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789478630 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478630.117327:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789478620/real 1789478620] req@ffff8ebb037e7b80 x1876403964506880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789478630 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478630.117341:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ebb037e7b80 x1876403964506880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789478630 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789478630.117375:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc1897e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789478630.117411:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789478630.117415:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964507008:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789478630.117420:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc34e1f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789478630.117426:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789478630.117428:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964506880:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789478630.117550:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789478630.117560:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789478630.117563:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789478630.117566:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789478630.117625:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789478630.117628:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789478630.117631:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ebc34e1f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789478630.117636:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 449 00000100:00080000:3.0:1789478630.117641:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789478630.117652:0:37:0:(import.c:625:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ebc34e1f800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1789478630.117669:0:37:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb03598380 x1876403964513536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789478630.117682:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789478630.117685:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789478630.117687:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ebc1897e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789478630.117690:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 449 00000100:00080000:3.0:1789478630.117693:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789478630.117697:0:37:0:(import.c:625:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ebc1897e000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1789478630.117709:0:37:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb0359ad80 x1876403964513664/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789478630.117742:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964513152:0@lo:400:kworker.0 00000100:00100000:3.0:1789478630.117752:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964513280:0@lo:400:kworker.0 00000100:00100000:1.0:1789478630.117931:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d53a32c3-7c45-4781-893e-f633d5432f2d:3647:1876403964513024:0@lo:400:kworker.0 00000100:00100000:3.0:1789478630.120187:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478630.120243:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789478630.120254:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964513408:0@lo:400:kworker.0 00000100:00100000:1.0:1789478630.121795:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478630.121802:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478630.121843:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964513792:0@lo:400:kworker.0 00000100:00100000:3.0:1789478630.121866:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964513280 00000100:00100000:3.0:1789478630.121873:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964513280 00000100:00100000:1.0:1789478630.121876:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478630.122117:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478630.122159:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964513408 00000100:00100000:0.0:1789478630.122164:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964513408 00000100:00100000:0.0:1789478630.122185:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964513152 00000100:00100000:0.0:1789478630.122188:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964513152 00000100:00100000:0.0:1789478630.122203:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789478630.122211:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964513408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478630.122267:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964513408:12345-0@lo:400:kworker.0 Request processed in 57us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478630.122274:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789478630.122290:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789478630.122297:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1876403964513152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478630.122315:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964513792 00000100:00100000:1.0:1789478630.122321:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964513792 00000100:00100000:0.0:1789478630.122334:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1876403964513152:12345-0@lo:400:kworker.0 Request processed in 36us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478630.122341:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789478630.122355:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789478630.122365:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0359b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964513280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478630.122382:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964513152:0@lo:400:kworker.0 00000100:00100000:0.0:1789478630.122409:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964513536:0@lo:8:kworker.0 00000100:00100000:3.0:1789478630.122418:0:17238:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789478630.122427:0:17238:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789478630.122445:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964513024 00000100:00100000:3.0:1789478630.122449:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964513024 00000100:00100000:3.0:1789478630.122473:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789478630.122481:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc38e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+18:3647:x1876403964513024:12345-0@lo:400:kworker.0 00000400:00000100:0.0:1789478630.125929:0:3644:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876403964513536 offset 0 length 520: 4 00000100:00100000:0.0:1789478630.125989:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964513664:0@lo:8:kworker.0 00000400:00000100:0.0:1789478630.126015:0:3644:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876403964513664 offset 0 length 520: 4 00000100:00100000:1.0:1789478630.129107:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0359b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964513280:12345-0@lo:400:kworker.0 Request processed in 6736us (8917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478630.129121:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789478630.129159:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789478630.129170:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964513792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478630.129232:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964513792:12345-0@lo:400:kworker.0 Request processed in 65us (7353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478630.129315:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789478630.129507:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc38e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+18:3647:x1876403964513024:12345-0@lo:400:kworker.0 Request processed in 7024us (7713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478630.129516:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789478630.130176:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964513408:0@lo:400:kworker.0 00010000:00080000:1.0:1789478630.130195:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ebb03599f80 x1876403964513280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478630.130206:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964513280:0@lo:400:kworker.0 00000100:00100000:2.0:1789478630.131325:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d53a32c3-7c45-4781-893e-f633d5432f2d:3647:1876403964513024:0@lo:400:kworker.0 00010000:00080000:2.0:1789478630.131346:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ebb0359b800 x1876403964513792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478630.131358:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964513792:0@lo:400:kworker.0 00000100:00100000:2.0:1789478630.632377:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964513920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789478630.632455:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478630.632511:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964513920 00000100:00100000:2.0:1789478630.632517:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964513920 00000100:00100000:2.0:1789478630.632559:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789478630.632568:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964513920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789478630.632618:0:17243:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789478630.632726:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964513920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 158us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478630.632747:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789478630.632793:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964513920:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789478630.633913:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478631.143666:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789478631.143686:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964514048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789478631.143760:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478631.143812:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964514048 00000100:00100000:2.0:1789478631.143819:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964514048 00000100:00100000:2.0:1789478631.143857:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789478631.143864:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876403964514048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789478631.143891:0:17243:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789478631.143931:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876403964514048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478631.143938:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789478631.143979:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964514048:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789478631.654753:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789478631.663288:0:17971:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789478632.164748:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789478617/real 1789478617] req@ffff8ebc34cb6d80 x1876403964504832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789478632 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478632.164780:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ebc34cb6d80 x1876403964504832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789478632 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478632.164789:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789478617/real 1789478617] req@ffff8ebc34cb4a80 x1876403964504960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789478632 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478632.164801:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ebc34cb4a80 x1876403964504960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789478632 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789478632.164819:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc3bcd8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789478632.164830:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789478632.164834:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964504832:0@lo:8:kworker.0 00000100:00080000:1.0:1789478632.164839:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc06fa9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789478632.164845:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789478632.164847:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964504960:0@lo:8:kworker.0 00000100:00080000:0.0:1789478632.166771:0:14273:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789478632.166777:0:14273:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:3.0:1789478632.166778:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1789478632.166780:0:14273:0:(import.c:65:import_set_state_nolock()) ffff8ebc3bcd8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789478632.166787:0:14273:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 446 00000100:00080000:0.0:1789478632.166791:0:14273:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:3.0:1789478632.166793:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d53a32c3-7c45-4781-893e-f633d5432f2d:3645:1876403964514176:0@lo:400:kworker.0 00000100:00080000:0.0:1789478632.166801:0:14273:0:(import.c:625:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ebc3bcd8800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1789478632.166819:0:14273:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb03feed80 x1876403964514432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789478632.166833:0:14273:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789478632.166836:0:14273:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789478632.166838:0:14273:0:(import.c:65:import_set_state_nolock()) ffff8ebc06fa9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789478632.166841:0:14273:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 446 00000100:00080000:0.0:1789478632.166842:0:14273:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789478632.166846:0:14273:0:(import.c:625:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ebc06fa9800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1789478632.166850:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478632.166870:0:14273:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb03fef100 x1876403964514560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789478632.166889:0:14273:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789478632.166893:0:14273:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789478632.166896:0:14273:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789478632.166899:0:14273:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789478632.166902:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964514176 00000100:00100000:3.0:1789478632.166908:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964514176 00000100:00100000:0.0:1789478632.166927:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964514304:0@lo:400:kworker.0 00000100:00100000:3.0:1789478632.166948:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789478632.166957:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc38e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+18:3645:x1876403964514176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478632.166957:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478632.166979:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789478632.166984:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964514688:0@lo:400:kworker.0 00000100:00100000:3.0:1789478632.166994:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc38e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+18:3645:x1876403964514176:12345-0@lo:400:kworker.0 Request processed in 39us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478632.167000:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789478632.167008:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478632.167034:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964514816:0@lo:400:kworker.0 00000100:00100000:0.0:1789478632.167035:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964514304 00000100:00100000:0.0:1789478632.167038:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964514304 00000100:00100000:3.0:1789478632.167055:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478632.167061:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964514816 00000100:00100000:0.0:1789478632.167063:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964514816 00000100:00100000:0.0:1789478632.167077:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789478632.167078:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d53a32c3-7c45-4781-893e-f633d5432f2d:3645:1876403964514176:0@lo:400:kworker.0 00000100:00100000:0.0:1789478632.167082:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964514304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478632.167091:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789478632.167095:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964514944:0@lo:400:kworker.0 00000100:00100000:0.0:1789478632.167119:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964514304:12345-0@lo:400:kworker.0 Request processed in 36us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478632.167126:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789478632.167138:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478632.167166:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964514688 00000100:00100000:3.0:1789478632.167169:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964514688 00000100:00100000:3.0:1789478632.167192:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964514944 00000100:00100000:3.0:1789478632.167195:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964514944 00000100:00100000:3.0:1789478632.167210:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789478632.167216:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964514688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478632.167296:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789478632.167303:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964514816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478632.167338:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964514816:12345-0@lo:400:kworker.0 Request processed in 36us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478632.167345:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789478632.167366:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789478632.167368:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964514688:12345-0@lo:400:kworker.0 Request processed in 153us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478632.167372:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964514944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478632.167375:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789478632.167396:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964514944:12345-0@lo:400:kworker.0 Request processed in 24us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478632.167401:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789478632.167428:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ebb03fee680 x1876403964514688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478632.167450:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964514688:0@lo:400:kworker.0 00000100:00100000:0.0:1789478632.167463:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964514304:0@lo:400:kworker.0 00000100:00100000:0.0:1789478632.167484:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03feed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964514432:0@lo:8:kworker.0 00000400:00000100:0.0:1789478632.167506:0:3644:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876403964514432 offset 0 length 520: 4 00000100:00100000:0.0:1789478632.167519:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964514560:0@lo:8:kworker.0 00000400:00000100:0.0:1789478632.167533:0:3644:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876403964514560 offset 0 length 520: 4 00010000:00080000:0.0:1789478632.167559:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ebb03feea00 x1876403964514944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478632.167567:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964514944:0@lo:400:kworker.0 00000100:00100000:0.0:1789478632.167955:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964514816:0@lo:400:kworker.0 00010000:00010000:1.0:1789478632.676754:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789478632.869501:0:17992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789478633.707060:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789478634.576849:0:18741:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789478634.576853:0:18741:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789478634.576854:0:18741:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789478634.576958:0:18741:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ebc35e74800 00000020:01000004:3.0:1789478634.576974:0:18741:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789478634.576987:0:18741:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789478634.577001:0:18741:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8ebc34c74d28) 00000020:00000080:3.0:1789478634.577017:0:18741:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789478634.629928:0:18741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789478634.632663:0:18741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789478634.633161:0:18741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789478634.633396:0:18741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789478634.633629:0:18741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789478634.633921:0:18741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789478634.634144:0:18741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1789478634.635532:0:18741:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789478634.636097:0:18741:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789478634.636109:0:18741:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789478634.636119:0:18741:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8ebaae74e82170f8 00000020:01000004:2.0:1789478634.636126:0:18741:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789478634.636145:0:18741:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.111@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789478634.636148:0:18741:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789478634.636153:0:18741:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789478634.636158:0:18741:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789478634.636170:0:18741:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8ebc06588000) 00000020:00000080:2.0:1789478634.636180:0:18741:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1789478634.637299:0:18741:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789478634.637448:0:18741:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789478634.637454:0:18741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789478634.646488:0:18741:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789478634.646502:0:18741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789478634.647105:0:18741:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789478634.647112:0:18741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789478634.650089:0:18741:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789478634.651026:0:18741:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789478634.651035:0:18741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789478634.653021:0:18741:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789478634.653032:0:18741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789478634.675416:0:18741:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789478634.675866:0:18741:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789478634.675873:0:18741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789478634.677125:0:18741:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789478634.677135:0:18741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789478634.678307:0:18741:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789478634.678322:0:18741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789478634.680518:0:18741:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789478634.680945:0:18741:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789478634.680952:0:18741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789478634.681534:0:18741:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789478634.681541:0:18741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789478634.716264:0:18741:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789478634.716533:0:18741:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789478634.716540:0:18741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789478634.717743:0:18741:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789478634.717753:0:18741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789478634.718295:0:18741:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789478634.718324:0:18741:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1789478634.718398:0:18741:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.111@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00010000:00010000:3.0:1789478634.725039:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789478634.730870:0:18741:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789478634.730908:0:18741:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.111@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789478634.730913:0:18741:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789478634.730914:0:18741:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789478634.730915:0:18741:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789478634.730916:0:18741:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789478634.730918:0:18741:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789478634.730919:0:18741:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789478634.730920:0:18741:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789478634.730922:0:18741:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789478634.730923:0:18741:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789478634.730927:0:18741:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789478634.730929:0:18741:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789478634.730930:0:18741:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789478634.730931:0:18741:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789478634.730933:0:18741:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789478634.730934:0:18741:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789478634.730939:0:18741:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789478634.730940:0:18741:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789478634.730941:0:18741:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789478634.730942:0:18741:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789478634.730964:0:18741:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789478634.730982:0:18741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964515072:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789478634.731054:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478634.731099:0:18741:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb02516180 going to sleep for 11 seconds 00000100:00100000:3.0:1789478634.731311:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964515072 00000100:00100000:3.0:1789478634.731318:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964515072 00000100:00100000:3.0:1789478634.731417:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789478634.731426:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+18:18741:x1876403964515072:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789478634.731463:0:17233:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789478634.731466:0:17233:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789478634.731471:0:17233:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789478634.731928:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+18:18741:x1876403964515072:12345-0@lo:253:mount.lustre.0 Request processed in 501us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478634.731936:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789478634.732017:0:18741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964515072:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789478634.732027:0:18741:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789478634.732030:0:18741:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789478634.732031:0:18741:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789478634.732033:0:18741:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789478634.732034:0:18741:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789478634.732035:0:18741:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789478634.732036:0:18741:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789478634.732037:0:18741:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789478634.732038:0:18741:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789478634.732039:0:18741:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789478634.732056:0:18741:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ebc35e74800 from lustre-OST0000 10000000:01000000:0.0:1789478634.732082:0:18741:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789478634.732084:0:18741:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789478634.732091:0:18741:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ebc40f719b8 local copy 00010000:00010000:0.0:1789478634.732100:0:18741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216eb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216eba expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478634.732201:0:18741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964515200:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789478634.732240:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478634.732666:0:18741:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb025169c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478634.732828:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964515200 00000100:00100000:2.0:1789478634.732835:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964515200 00000100:00100000:2.0:1789478634.732868:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789478634.732876:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+18:18741:x1876403964515200:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789478634.732993:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+18:18741:x1876403964515200:12345-0@lo:501:mount.lustre.0 Request processed in 118us (753us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789478634.733000:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789478634.734010:0:18741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964515200:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789478634.734029:0:18741:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789478634.734055:0:18741:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789478634.734072:0:18741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216eb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216eba expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.734082:0:18741:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216eba expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478634.734111:0:18741:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ebc35e74800 10000000:01000000:0.0:1789478634.734115:0:18741:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789478634.734120:0:18741:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789478634.734122:0:18741:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789478634.734127:0:18741:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789478634.734129:0:18741:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789478634.734273:0:18741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40f05c00/0x8ebaae74e8217106 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.734282:0:18741:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc40f05c00/0x8ebaae74e8217106 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.734293:0:18741:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc40f05c00/0x8ebaae74e8217106 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478634.734310:0:18741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964515328:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789478634.734356:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478634.734394:0:18741:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb025169c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478634.734559:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964515328 00000100:00100000:2.0:1789478634.734564:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964515328 00000100:00100000:2.0:1789478634.734671:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789478634.734679:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+18:18741:x1876403964515328:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789478634.734690:0:17232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478634.734701:0:17232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc34f76000/0x8ebaae74e821710d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8217106 expref: -99 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478634.734734:0:17232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc34f76000/0x8ebaae74e821710d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8217106 expref: 19 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478634.734744:0:17232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc34f76000/0x8ebaae74e821710d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8217106 expref: 19 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478634.734820:0:17232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc34f76000, rc 0) 00000100:00100000:2.0:1789478634.734859:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+19:18741:x1876403964515328:12345-0@lo:101:mount.lustre.0 Request processed in 181us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478634.734865:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789478634.734946:0:18741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964515328:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789478634.734958:0:18741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc40f05c00/0x8ebaae74e8217106 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e821710d expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.734967:0:18741:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc40f05c00/0x8ebaae74e8217106 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e821710d expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789478634.736037:0:18741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789478634.736674:0:18741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789478634.740526:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789478634.740585:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789478634.740746:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789478634.740837:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789478634.740853:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789478634.740866:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789478634.740890:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789478634.740896:0:18741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789478634.740991:0:18741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964515456:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789478634.741052:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478634.741147:0:18741:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb02516e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789478634.741303:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964515456 00000100:00100000:1.0:1789478634.741310:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964515456 00000100:00100000:1.0:1789478634.741358:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789478634.741368:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+19:18741:x1876403964515456:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789478634.741553:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+19:18741:x1876403964515456:12345-0@lo:501:mount.lustre.0 Request processed in 186us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478634.741561:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789478634.741837:0:18741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964515456:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789478634.741871:0:18741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964515584:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789478634.741917:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478634.741947:0:18741:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb02516e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789478634.741999:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964515584 00000100:00100000:2.0:1789478634.742004:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964515584 00000100:00100000:2.0:1789478634.742073:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789478634.742081:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+19:18741:x1876403964515584:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789478634.742870:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+19:18741:x1876403964515584:12345-0@lo:503:mount.lustre.0 Request processed in 787us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478634.742878:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789478634.742970:0:18741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964515584:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789478634.743363:0:18741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789478634.743424:0:18741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964515712:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789478634.743460:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478634.743781:0:18741:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb02516e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789478634.743886:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964515712 00000100:00100000:1.0:1789478634.743893:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964515712 00000100:00100000:1.0:1789478634.743924:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789478634.743932:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+19:18741:x1876403964515712:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789478634.744364:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+19:18741:x1876403964515712:12345-0@lo:502:mount.lustre.0 Request processed in 431us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478634.744372:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789478634.744446:0:18741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964515712:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789478634.744642:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789478634.744670:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789478634.744695:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789478634.744719:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789478634.744736:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789478634.744749:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789478634.744840:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789478634.744855:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789478634.744868:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1789478634.744894:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1789478634.744909:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1789478634.744921:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1789478634.744947:0:18741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964515840:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789478634.744985:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478634.745013:0:18741:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb02516e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789478634.745089:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964515840 00000100:00100000:1.0:1789478634.745094:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964515840 00000100:00100000:1.0:1789478634.745116:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789478634.745124:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+19:18741:x1876403964515840:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789478634.745342:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+19:18741:x1876403964515840:12345-0@lo:502:mount.lustre.0 Request processed in 218us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478634.745348:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789478634.745416:0:18741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964515840:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789478634.745453:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1789478634.745461:0:18741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1789478634.746470:0:18758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789478634.746480:0:18758:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1789478634.746487:0:18758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478634.746489:0:18758:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789478634.746497:0:18758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789478634.746512:0:18758:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8ebc3f733370) 00000020:00000080:1.0:1789478634.746537:0:18758:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789478634.746549:0:18758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789478634.746920:0:18758:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ebc35e74800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789478634.746928:0:18758:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789478634.746935:0:18758:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8ebaae74e821711b 00010000:00010000:1.0:1789478634.752020:0:18758:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1789478634.752450:0:18758:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1789478634.754408:0:18758:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1789478634.756410:0:18758:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789478634.756423:0:18758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789478634.756430:0:18758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478634.756432:0:18758:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789478634.756435:0:18758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789478634.756438:0:18758:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1789478634.756448:0:18758:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789478634.756450:0:18758:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789478634.756452:0:18758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789478634.756455:0:18758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478634.756456:0:18758:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789478634.756458:0:18758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789478634.756462:0:18758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478634.756463:0:18758:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789478634.756466:0:18758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789478634.756467:0:18758:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789478634.756470:0:18758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789478634.756472:0:18758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478634.756474:0:18758:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789478634.756475:0:18758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789478634.756477:0:18758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478634.756478:0:18758:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789478634.756481:0:18758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789478634.756509:0:18758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789478634.756512:0:18758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789478634.756513:0:18758:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789478634.756516:0:18758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1789478634.756772:0:18741:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789478634.756864:0:18741:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789478634.756996:0:18741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40f05c00/0x8ebaae74e8217106 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e821710d expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478634.757009:0:18741:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc40f05c00/0x8ebaae74e8217106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e821710d expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478634.757018:0:18741:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebc35e74800 from 1 10000000:01000000:1.0:1789478634.757021:0:18741:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789478634.757054:0:18741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ac00/0x8ebaae74e8217122 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478634.757062:0:18741:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ac00/0x8ebaae74e8217122 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478634.757073:0:18741:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ac00/0x8ebaae74e8217122 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478634.757097:0:18741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964515968:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789478634.757160:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478634.757198:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964515968 00000100:00100000:1.0:1789478634.757205:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964515968 00000100:00100000:1.0:1789478634.757263:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789478634.757271:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+19:18741:x1876403964515968:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789478634.757286:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478634.757298:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc08c4ae00/0x8ebaae74e8217129 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8217122 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478634.757322:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc08c4ae00/0x8ebaae74e8217129 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8217122 expref: 20 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478634.757344:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc08c4ae00/0x8ebaae74e8217129 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8217122 expref: 20 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478634.757353:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4ae00, rc 0) 00000100:00100000:1.0:1789478634.757384:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+20:18741:x1876403964515968:12345-0@lo:101:mount.lustre.0 Request processed in 114us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478634.757392:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789478634.757440:0:18741:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc20313e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789478634.757461:0:18741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964515968:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789478634.757476:0:18741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ac00/0x8ebaae74e8217122 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217129 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478634.757484:0:18741:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ac00/0x8ebaae74e8217122 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8217129 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789478634.760116:0:18741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789478634.760494:0:18741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789478634.760704:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789478634.760741:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789478634.760759:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789478634.760771:0:18741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789478634.761474:0:18741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964516096:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789478634.761531:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478634.761581:0:18741:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc203139c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478634.761628:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964516096 00000100:00100000:0.0:1789478634.761634:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964516096 00000100:00100000:0.0:1789478634.761674:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789478634.761682:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+20:18741:x1876403964516096:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789478634.761813:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+20:18741:x1876403964516096:12345-0@lo:501:mount.lustre.0 Request processed in 131us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478634.761822:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789478634.761896:0:18741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964516096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789478634.761931:0:18741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964516224:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789478634.761971:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478634.761998:0:18741:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0263f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478634.762027:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964516224 00000100:00100000:0.0:1789478634.762032:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964516224 00000100:00100000:0.0:1789478634.762065:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789478634.762072:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+20:18741:x1876403964516224:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789478634.762159:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+20:18741:x1876403964516224:12345-0@lo:503:mount.lustre.0 Request processed in 86us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478634.762171:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789478634.762247:0:18741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964516224:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789478634.762670:0:18741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789478634.762758:0:18741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964516352:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789478634.763470:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478634.763555:0:18741:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08d12300 going to sleep for 11 seconds 00000100:00100000:0.0:1789478634.764755:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964516352 00000100:00100000:0.0:1789478634.764766:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964516352 00000100:00100000:0.0:1789478634.764988:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789478634.764998:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+20:18741:x1876403964516352:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789478634.765200:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+20:18741:x1876403964516352:12345-0@lo:502:mount.lustre.0 Request processed in 201us (1729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478634.765210:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789478634.767559:0:18741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964516352:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789478634.768430:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789478634.768466:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789478634.768481:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789478634.768494:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789478634.768508:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789478634.768523:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789478634.768537:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789478634.768551:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1789478634.768563:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789478634.768575:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1789478634.768587:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1789478634.768862:0:18741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964516480:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789478634.768997:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478634.769074:0:18741:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05483a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789478634.769110:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964516480 00000100:00100000:1.0:1789478634.769117:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964516480 00000100:00100000:1.0:1789478634.769191:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789478634.769200:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+20:18741:x1876403964516480:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789478634.769318:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+20:18741:x1876403964516480:12345-0@lo:502:mount.lustre.0 Request processed in 119us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478634.769335:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789478634.769413:0:18741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964516480:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789478634.769471:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1789478634.769481:0:18741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789478634.770195:0:18762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789478634.770203:0:18762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478634.770205:0:18762:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789478634.770210:0:18762:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ebc35e74800 00000020:00000080:3.0:1789478634.770213:0:18762:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789478634.770220:0:18762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789478634.770222:0:18762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478634.770223:0:18762:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789478634.770226:0:18762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789478634.770228:0:18762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478634.770229:0:18762:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789478634.770232:0:18762:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ebc35e74800 00000020:00000080:3.0:1789478634.770234:0:18762:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789478634.770304:0:18762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789478634.770308:0:18762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478634.770310:0:18762:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789478634.770312:0:18762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789478634.770315:0:18762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478634.770316:0:18762:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789478634.770319:0:18762:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ebc35e74800 00000020:00000080:3.0:1789478634.770321:0:18762:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789478634.771894:0:18762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789478634.771901:0:18762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478634.771902:0:18762:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789478634.771905:0:18762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789478634.771908:0:18762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478634.771909:0:18762:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789478634.771913:0:18762:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ebc35e74800 00000020:00000080:3.0:1789478634.771915:0:18762:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789478634.771945:0:18762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789478634.771955:0:18762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789478634.771956:0:18762:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789478634.771959:0:18762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1789478634.775664:0:18741:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789478634.775724:0:18741:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789478634.775748:0:18741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ac00/0x8ebaae74e8217122 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217129 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478634.775760:0:18741:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ac00/0x8ebaae74e8217122 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217129 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478634.775987:0:18741:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789478634.775991:0:18741:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ebc35e74800 10000000:01000000:3.0:1789478634.775993:0:18741:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ebc35e74800 10000000:01000000:3.0:1789478634.775997:0:18741:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789478634.776002:0:18741:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ebc35e74800 from 1 10000000:01000000:3.0:1789478634.776004:0:18741:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789478634.776034:0:18741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fca00/0x8ebaae74e8217130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478634.776043:0:18741:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebb035fca00/0x8ebaae74e8217130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478634.776054:0:18741:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebb035fca00/0x8ebaae74e8217130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478634.776076:0:18741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964516608:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789478634.776136:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478634.776180:0:18741:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08d129c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478634.776983:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964516608 00000100:00100000:1.0:1789478634.776992:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964516608 00000100:00100000:1.0:1789478634.777035:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789478634.777043:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+20:18741:x1876403964516608:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789478634.777056:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478634.777069:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc08c4b000/0x8ebaae74e8217137 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8217130 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478634.777096:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc08c4b000/0x8ebaae74e8217137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8217130 expref: 21 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478634.777106:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc08c4b000/0x8ebaae74e8217137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8217130 expref: 21 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478634.777115:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4b000, rc 0) 00000100:00100000:1.0:1789478634.777168:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+21:18741:x1876403964516608:12345-0@lo:101:mount.lustre.0 Request processed in 125us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478634.777181:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789478634.785956:0:18741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964516608:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789478634.785993:0:18741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebb035fca00/0x8ebaae74e8217130 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217137 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478634.786005:0:18741:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebb035fca00/0x8ebaae74e8217130 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8217137 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789478634.787427:0:18741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789478634.787742:0:18741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789478634.788038:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789478634.788061:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789478634.788088:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789478634.788104:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789478634.788117:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789478634.788131:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789478634.788566:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789478634.788582:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789478634.788615:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789478634.788632:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789478634.788645:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789478634.788658:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789478634.788673:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789478634.788691:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789478634.788704:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789478634.788732:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789478634.788745:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789478634.788833:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789478634.788862:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789478634.788877:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789478634.788891:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789478634.788903:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789478634.788915:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789478634.788929:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789478634.788953:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1789478634.788968:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1789478634.788981:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1789478634.788993:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1789478634.789006:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1789478634.789019:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1789478634.789031:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1789478634.789042:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1789478634.789053:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1789478634.789065:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1789478634.789092:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1789478634.789109:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1789478634.789122:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1789478634.789158:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1789478634.789164:0:18741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789478634.789542:0:18741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964516736:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789478634.789629:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478634.789659:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964516736 00000100:00100000:1.0:1789478634.789666:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964516736 00000100:00100000:1.0:1789478634.789719:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789478634.789723:0:18741:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08d12c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789478634.789729:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+21:18741:x1876403964516736:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789478634.789872:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+21:18741:x1876403964516736:12345-0@lo:501:mount.lustre.0 Request processed in 145us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478634.789892:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789478634.790381:0:18741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964516736:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789478634.790413:0:18741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964516864:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789478634.790466:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478634.790493:0:18741:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08d12c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789478634.792102:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964516864 00000100:00100000:1.0:1789478634.792116:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964516864 00000100:00100000:1.0:1789478634.792164:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789478634.792173:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+21:18741:x1876403964516864:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789478634.792311:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+21:18741:x1876403964516864:12345-0@lo:503:mount.lustre.0 Request processed in 139us (1844us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478634.792319:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789478634.792618:0:18741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964516864:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789478634.793098:0:18741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789478634.793196:0:18741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964516992:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789478634.793325:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478634.793357:0:18741:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08d129c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478634.793427:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964516992 00000100:00100000:1.0:1789478634.793433:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964516992 00000100:00100000:1.0:1789478634.793469:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789478634.793478:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+21:18741:x1876403964516992:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789478634.793578:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+21:18741:x1876403964516992:12345-0@lo:502:mount.lustre.0 Request processed in 101us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478634.793585:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789478634.793699:0:18741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964516992:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789478634.794030:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789478634.794055:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789478634.794066:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789478634.794077:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789478634.794088:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789478634.794098:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789478634.794110:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789478634.794120:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789478634.794131:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789478634.794142:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789478634.794167:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789478634.794179:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789478634.794189:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789478634.794200:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789478634.794210:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789478634.794223:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789478634.794235:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789478634.794247:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789478634.794259:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789478634.794273:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789478634.794286:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789478634.794297:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789478634.794310:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789478634.794323:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789478634.798042:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1789478634.798067:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1789478634.798100:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1789478634.798116:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1789478634.798129:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1789478634.798142:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1789478634.798156:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1789478634.798170:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1789478634.798194:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1789478634.798207:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1789478634.798220:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1789478634.798234:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1789478634.798246:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1789478634.798258:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1789478634.798269:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1789478634.798280:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1789478634.798292:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1789478634.798304:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1789478634.798332:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1789478634.798347:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1789478634.798359:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1789478634.798372:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1789478634.798385:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1789478634.798398:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1789478634.798456:0:18741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964517120:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789478634.798537:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478634.798583:0:18741:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08d129c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478634.798652:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964517120 00000100:00100000:3.0:1789478634.798659:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964517120 00000100:00100000:3.0:1789478634.798705:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789478634.798726:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+21:18741:x1876403964517120:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789478634.798845:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+21:18741:x1876403964517120:12345-0@lo:502:mount.lustre.0 Request processed in 119us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478634.798852:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789478634.798904:0:18741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964517120:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789478634.799059:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1789478634.799080:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1789478634.799108:0:18741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964517248:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789478634.799140:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478634.799159:0:18741:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08d129c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478634.799991:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964517248 00000100:00100000:1.0:1789478634.799999:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964517248 00000100:00100000:1.0:1789478634.800083:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789478634.800093:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+21:18741:x1876403964517248:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789478634.800201:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+21:18741:x1876403964517248:12345-0@lo:502:mount.lustre.0 Request processed in 109us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478634.800208:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789478634.804143:0:18741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964517248:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789478634.804242:0:18741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1789478634.804257:0:18741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789478634.805678:0:18767:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789478634.805692:0:18767:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8ebc0658b370) 00000020:00000080:2.0:1789478634.805726:0:18767:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1789478634.806267:0:18767:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ebc35e74800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789478634.806272:0:18767:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ebc35e74800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789478634.806274:0:18767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ebc35e74800 3 00010000:00080000:2.0:1789478634.806307:0:18767:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ebb03347800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.111@tcp at head 00010000:00010000:2.0:1789478634.808688:0:18767:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1789478634.809535:0:18767:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789478634.809581:0:18767:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789478634.809697:0:18767:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8ebaae74e8217145 00000100:00080000:2.0:1789478634.809718:0:18767:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789478634.809729:0:18767:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ebb03347800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1789478634.809772:0:18767:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebc34cb4700 x1876403964517376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789478634.810466:0:18767:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789478634.810763:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789478634.810768:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789478634.810771:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789478634.810774:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789478634.810808:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789478634.810811:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789478634.810814:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789478634.810817:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789478634.810853:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876403964517632:0@lo:400:kworker.0 00000100:00100000:1.0:1789478634.811036:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478634.811066:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789478634.811072:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964517504:0@lo:400:kworker.0 00000100:00100000:1.0:1789478634.811093:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478634.811117:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964517760:0@lo:400:kworker.0 00000100:00100000:1.0:1789478634.811134:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478634.811150:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789478634.811155:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964517888:0@lo:400:kworker.0 00000100:00100000:1.0:1789478634.811176:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478634.811208:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964517632 00000100:00100000:1.0:1789478634.811214:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964517632 00000100:00100000:1.0:1789478634.811260:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964517888 00000100:00100000:1.0:1789478634.811263:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964517888 00000100:00100000:1.0:1789478634.811283:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789478634.811290:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876403964517632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478634.811401:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876403964517632:12345-0@lo:400:kworker.0 Request processed in 111us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478634.811408:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789478634.811422:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789478634.811428:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964517888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478634.811457:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964517888:12345-0@lo:400:kworker.0 Request processed in 30us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478634.811463:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789478634.811480:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964517504 00000100:00100000:1.0:1789478634.811483:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964517504 00000100:00100000:1.0:1789478634.811495:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964517760 00000100:00100000:1.0:1789478634.811497:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964517760 00000100:00100000:1.0:1789478634.811506:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789478634.811511:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964517504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478634.811536:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964517504:12345-0@lo:400:kworker.0 Request processed in 25us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478634.811541:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789478634.811549:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789478634.811554:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964517760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478634.811588:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964517760:12345-0@lo:400:kworker.0 Request processed in 34us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478634.811621:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789478634.811663:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964517504:0@lo:400:kworker.0 00010000:00080000:1.0:1789478634.811684:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ebb037e7100 x1876403964517632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478634.811695:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876403964517632:0@lo:400:kworker.0 00010000:00080000:1.0:1789478634.811731:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ebb037e6a00 x1876403964517888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478634.811740:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964517888:0@lo:400:kworker.0 00000100:00100000:1.0:1789478634.811747:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964517760:0@lo:400:kworker.0 00000100:00100000:2.0:1789478634.814149:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876403964517376:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789478634.814243:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478634.814857:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964517376 00000100:00100000:1.0:1789478634.814866:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964517376 00000100:00100000:1.0:1789478634.815447:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789478634.815455:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876403964517376:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789478634.815483:0:17239:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:1.0:1789478634.815522:0:17239:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8ebaae74e821714c 00000004:00100000:1.0:1789478634.815538:0:17239:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789478634.815570:0:17239:0:(import.c:65:import_set_state_nolock()) ffff8ebc3f68c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789478634.815842:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876403964517376:12345-0@lo:38:llog_process_th.0 Request processed in 386us (1598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478634.815849:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:3.0:1789478634.819620:0:18767:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789478634.819640:0:18767:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8ebc34c719b8) 00000020:00000080:3.0:1789478634.819664:0:18767:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1789478634.819750:0:18767:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ebc35e74800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789478634.819754:0:18767:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ebc35e74800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789478634.819757:0:18767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ebc35e74800 3 00010000:00080000:3.0:1789478634.819846:0:18767:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ebb01b7b000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.111@tcp at head 00010000:00080000:2.0:1789478634.821235:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ebc34cb4700 x1876403964517376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789478644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478634.821250:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789478634.821260:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789478634.821269:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789478634.821274:0:3644:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789478634.821278:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebb03347800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789478634.821285:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876403964517376:0@lo:38:llog_process_th.0 00010000:00010000:2.0:1789478634.825157:0:18767:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1789478634.826620:0:18767:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1789478634.826690:0:18767:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789478634.826705:0:18767:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x8ebaae74e821715a 00000100:00080000:2.0:1789478634.826727:0:18767:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789478634.826738:0:18767:0:(import.c:625:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8ebb01b7b000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1789478634.826771:0:18767:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebc34cb4700 x1876403964518016/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789478634.826954:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876403964518016:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789478634.827014:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478634.827055:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964518016 00000100:00100000:2.0:1789478634.827061:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964518016 00000100:00100000:2.0:1789478634.827100:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789478634.827107:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876403964518016:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789478634.827131:0:17240:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:2.0:1789478634.827158:0:17240:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x8ebaae74e8217161 00000004:00100000:2.0:1789478634.827171:0:17240:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789478634.827197:0:17240:0:(import.c:65:import_set_state_nolock()) ffff8ebb03341800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789478634.827237:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876403964518016:12345-0@lo:38:llog_process_th.0 Request processed in 130us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478634.827244:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789478634.827289:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ebc34cb4700 x1876403964518016/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789478644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478634.827299:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789478634.827306:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789478634.827313:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789478634.827316:0:3644:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789478634.827318:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebb01b7b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789478634.827323:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876403964518016:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789478634.827345:0:18767:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789478634.827364:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789478634.827368:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789478634.827371:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789478634.827373:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789478634.827376:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789478634.827378:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789478634.827386:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789478634.827389:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1789478634.827740:0:18767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1789478634.828078:0:18741:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789478634.828105:0:18741:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789478634.828128:0:18741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fca00/0x8ebaae74e8217130 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217137 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478634.828139:0:18741:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebb035fca00/0x8ebaae74e8217130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217137 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789478634.828184:0:18741:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789478634.828186:0:18741:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789478634.828187:0:18741:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478634.828188:0:18741:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478634.828189:0:18741:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478634.828191:0:18741:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478634.828192:0:18741:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789478634.828193:0:18741:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478634.828194:0:18741:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789478634.828197:0:18741:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789478634.828200:0:18741:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789478634.828201:0:18741:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789478634.828202:0:18741:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478634.828203:0:18741:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478634.828204:0:18741:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478634.828205:0:18741:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478634.828206:0:18741:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789478634.828207:0:18741:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478634.828207:0:18741:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789478634.828223:0:18741:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789478634.828235:0:18741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964518144:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789478634.828273:0:18741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478634.828301:0:18741:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc04fcad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789478634.830059:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964518144 00000100:00100000:3.0:1789478634.830073:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964518144 00000100:00100000:3.0:1789478634.830143:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789478634.830154:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+21:18741:x1876403964518144:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789478634.830182:0:17232:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789478634.830196:0:17232:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789478634.841207:0:17232:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789478634.841232:0:17232:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789478634.841419:0:17254:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789478634.841424:0:17254:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789478634.841444:0:17254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ebc40f04a00/0x8ebaae74e8217168 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.841462:0:17254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebb035fc600/0x8ebaae74e82170b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e82170ab expref: 21 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.841484:0:17254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebb035fcc00/0x8ebaae74e82170c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e82170b9 expref: 21 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.841492:0:17254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ebc40f04a00/0x8ebaae74e8217168 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.841527:0:17254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebb035fcc00/0x8ebaae74e82170c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e82170b9 expref: 21 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.841541:0:17254:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ebb035fcc00/0x8ebaae74e82170c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e82170b9 expref: 21 pid: 17234 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478634.841556:0:17254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03feea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17254:1876403964518272:0@lo:104: 00000100:00100000:0.0:1789478634.841638:0:17254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789478634.841686:0:17254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebb035fc600/0x8ebaae74e82170b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e82170ab expref: 21 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.841695:0:17254:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ebb035fc600/0x8ebaae74e82170b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e82170ab expref: 21 pid: 17232 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478634.841703:0:17254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fee680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17254:1876403964518400:0@lo:104: 00000100:00100000:0.0:1789478634.841738:0:17254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478634.841756:0:17254:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb0360ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789478634.841790:0:17222:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789478634.841806:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964518272 00000100:00100000:0.0:1789478634.841812:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964518272 00000100:00100000:0.0:1789478634.841841:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964518400 00000100:00100000:0.0:1789478634.841844:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964518400 00000100:00100000:0.0:1789478634.841859:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789478634.841884:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d53a32c3-7c45-4781-893e-f633d5432f2d+4:17254:x1876403964518272:12345-0@lo:104: 00010000:00010000:0.0:1789478634.841897:0:17222:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebb035fce00/0x8ebaae74e82170b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e82170c0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.841947:0:17222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789478634.841953:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d53a32c3-7c45-4781-893e-f633d5432f2d+4:17254:x1876403964518272:12345-0@lo:104: Request processed in 81us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478634.841960:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789478634.841977:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789478634.841984:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc38e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d53a32c3-7c45-4781-893e-f633d5432f2d+3:17254:x1876403964518400:12345-0@lo:104: 00010000:00010000:0.0:1789478634.841991:0:17222:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc029df200/0x8ebaae74e82170ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e82170b2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842023:0:17222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789478634.842028:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc38e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d53a32c3-7c45-4781-893e-f633d5432f2d+3:17254:x1876403964518400:12345-0@lo:104: Request processed in 45us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478634.842034:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789478634.842068:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789478634.842074:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebb035fce00/0x8ebaae74e82170b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e82170c0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842082:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fce00 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478634.842085:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebb035fce00/0x8ebaae74e82170b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e82170c0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842094:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebb035fce00/0x8ebaae74e82170b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e82170c0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478634.842101:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebb035fce00/0x8ebaae74e82170b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e82170c0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478634.842113:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789478634.842141:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebb035fce00/0x8ebaae74e82170b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e82170c0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842147:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478634.842167:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebb035fce00/0x8ebaae74e82170b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e82170c0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842173:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebb035fce00/0x8ebaae74e82170b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e82170c0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842183:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789478634.842186:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc029df200/0x8ebaae74e82170ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e82170b2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842192:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029df200 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:0.0:1789478634.842195:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc029df200/0x8ebaae74e82170ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e82170b2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842202:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc029df200/0x8ebaae74e82170ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e82170b2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789478634.842208:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc029df200/0x8ebaae74e82170ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e82170b2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478634.842213:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789478634.842226:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc029df200/0x8ebaae74e82170ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e82170b2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842232:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789478634.842245:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc029df200/0x8ebaae74e82170ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e82170b2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842251:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc029df200/0x8ebaae74e82170ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e82170b2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842266:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478634.842267:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478634.842269:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478634.842275:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478634.842285:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d53a32c3-7c45-4781-893e-f633d5432f2d:3647:1876403964518528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789478634.842313:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478634.842347:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789478634.842353:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03feca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d53a32c3-7c45-4781-893e-f633d5432f2d:3647:1876403964518656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789478634.842390:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478634.842422:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964518528 00000100:00100000:0.0:1789478634.842426:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964518528 00010000:00010000:0.0:1789478634.842442:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebb035fcc00/0x8ebaae74e82170c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e82170b9 expref: 22 pid: 17234 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478634.842461:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964518656 00000100:00100000:0.0:1789478634.842464:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964518656 00010000:00010000:0.0:1789478634.842474:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebb035fc600/0x8ebaae74e82170b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e82170ab expref: 23 pid: 17232 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478634.842490:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789478634.842497:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d53a32c3-7c45-4781-893e-f633d5432f2d+23:3647:x1876403964518528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789478634.842506:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478634.842511:0:17226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebb035fcc00/0x8ebaae74e82170c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e82170b9 expref: 23 pid: 17234 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842531:0:17226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebb035fcc00/0x8ebaae74e82170c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e82170b9 expref: 23 pid: 17234 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842546:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478634.842574:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d53a32c3-7c45-4781-893e-f633d5432f2d+23:3647:x1876403964518528:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478634.842580:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789478634.842613:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789478634.842618:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3d628050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d53a32c3-7c45-4781-893e-f633d5432f2d+22:3647:x1876403964518656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789478634.842626:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478634.842629:0:17226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebb035fc600/0x8ebaae74e82170b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e82170ab expref: 22 pid: 17232 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842637:0:17226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebb035fc600/0x8ebaae74e82170b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e82170ab expref: 22 pid: 17232 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842647:0:17226:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ebc40f04a00/0x8ebaae74e8217168 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842653:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40f04a00/0x8ebaae74e8217168 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789478634.842663:0:17226:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009990423s 00010000:00010000:0.0:1789478634.842668:0:17226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc40f04a00/0x8ebaae74e8217168 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842675:0:17226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc40f04a00/0x8ebaae74e8217168 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842690:0:17226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ebc40f04a00/0x8ebaae74e8217168 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842696:0:17226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ebc40f04a00/0x8ebaae74e8217168 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842702:0:17226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40f04a00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:0.0:1789478634.842716:0:17226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ebc40f04a00/0x8ebaae74e8217168 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842724:0:17226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ebc40f04a00/0x8ebaae74e8217168 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842732:0:17226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ebc40f04a00/0x8ebaae74e8217168 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842741:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478634.842764:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3d628050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d53a32c3-7c45-4781-893e-f633d5432f2d+22:3647:x1876403964518656:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478634.842771:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789478634.842833:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03feca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d53a32c3-7c45-4781-893e-f633d5432f2d:3647:1876403964518656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789478634.842843:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d53a32c3-7c45-4781-893e-f633d5432f2d:3647:1876403964518528:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789478634.842871:0:17254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebb035fcc00/0x8ebaae74e82170c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e82170b9 expref: 21 pid: 17234 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478634.842880:0:17254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03feea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17254:1876403964518272:0@lo:104: 00010000:00010000:0.0:1789478634.842889:0:17254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebb035fc600/0x8ebaae74e82170b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e82170ab expref: 20 pid: 17232 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478634.842904:0:17254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fee680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17254:1876403964518400:0@lo:104: 00010000:00010000:0.0:1789478634.842917:0:17254:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ebc40f04a00/0x8ebaae74e8217168 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842925:0:17254:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ebc40f04a00/0x8ebaae74e8217168 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842931:0:17254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ebc40f04a00/0x8ebaae74e8217168 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478634.842937:0:17254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc40f04a00/0x8ebaae74e8217168 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478634.843476:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+19:18741:x1876403964518144:12345-0@lo:253:mount.lustre.0 Request processed in 13321us (15198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478634.843488:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789478634.844238:0:18741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:18741:1876403964518144:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789478634.844252:0:18741:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789478634.844255:0:18741:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789478634.844256:0:18741:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789478634.844257:0:18741:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478634.844258:0:18741:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478634.844259:0:18741:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478634.844261:0:18741:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478634.844262:0:18741:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789478634.844264:0:18741:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478634.844265:0:18741:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789478634.844275:0:18741:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:3.0:1789478634.847395:0:18741:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789478634.852497:0:18741:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789478634.852506:0:18741:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789478634.852538:0:18741:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789478634.852580:0:18741:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.111@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789478634.852619:0:18741:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789478634.852639:0:18741:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1789478634.853426:0:18741:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789478634.853672:0:18741:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1789478635.688167:0:18820:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789478635.688412:0:18820:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789478635.752470:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478635.756662:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964518784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789478635.756759:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478635.756814:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964518784 00000100:00100000:3.0:1789478635.756821:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964518784 00000100:00100000:3.0:1789478635.756866:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789478635.756876:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964518784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789478635.756909:0:17243:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789478635.756968:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964518784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478635.756975:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789478635.757031:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964518784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478636.261050:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789478636.261073:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964518912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789478636.261145:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478636.261249:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964518912 00000100:00100000:2.0:1789478636.261256:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964518912 00000100:00100000:2.0:1789478636.261316:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789478636.261325:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964518912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789478636.261364:0:17243:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789478636.261472:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964518912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 147us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478636.261480:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789478636.261524:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964518912:0@lo:41:osp-pre-1-0.0 10000000:01000000:3.0:1789478636.773706:0:17236:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789478636.773718:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ebc35b1c000 from 9 10000000:01000000:3.0:1789478636.773725:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789478636.773737:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478636.773787:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e821716f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478636.773802:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e821716f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478636.773816:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e821716f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478636.773849:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964519040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789478636.773933:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478636.773986:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05530180 going to sleep for 11 seconds 00000100:00100000:0.0:1789478636.774045:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964519040 00000100:00100000:0.0:1789478636.774056:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964519040 00000100:00100000:0.0:1789478636.774125:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789478636.774137:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+19:17236:x1876403964519040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789478636.774154:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478636.774186:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40f04400/0x8ebaae74e8217176 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e821716f expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478636.774212:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40f04400/0x8ebaae74e8217176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e821716f expref: 20 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478636.774239:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40f04400/0x8ebaae74e8217176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e821716f expref: 20 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478636.774248:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40f04400, rc 0) 00000100:00100000:0.0:1789478636.774320:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+20:17236:x1876403964519040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478636.774327:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789478636.774589:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964519040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789478636.774639:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e821716f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217176 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478636.774654:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e821716f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8217176 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478636.774721:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964519168:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789478636.774758:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478636.774785:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05530180 going to sleep for 11 seconds 00000100:00100000:0.0:1789478636.774846:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964519168 00000100:00100000:0.0:1789478636.774850:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964519168 00000100:00100000:0.0:1789478636.774891:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789478636.774899:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+20:17236:x1876403964519168:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789478636.774913:0:17232:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789478636.774928:0:17232:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789478636.774931:0:17232:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1789478636.775004:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+20:17236:x1876403964519168:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478636.775010:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789478636.775192:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964519168:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789478636.775244:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789478636.775251:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e821716f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217176 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478636.775259:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e821716f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217176 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789478636.775268:0:17236:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789478636.775271:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ebb0372d800 from 9 10000000:01000000:3.0:1789478636.775273:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789478636.775293:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e821717d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478636.775300:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e821717d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478636.775309:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e821717d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478636.775322:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964519296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789478636.775353:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478636.775386:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05530180 going to sleep for 11 seconds 00000100:00100000:0.0:1789478636.775552:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964519296 00000100:00100000:0.0:1789478636.775556:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964519296 00000100:00100000:0.0:1789478636.775589:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789478636.775616:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+20:17236:x1876403964519296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789478636.775625:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478636.775634:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40f04e00/0x8ebaae74e8217184 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e821717d expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478636.775649:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40f04e00/0x8ebaae74e8217184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e821717d expref: 21 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478636.775668:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40f04e00/0x8ebaae74e8217184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e821717d expref: 21 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478636.775675:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40f04e00, rc 0) 00000100:00100000:0.0:1789478636.775716:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+21:17236:x1876403964519296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478636.775722:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789478636.776062:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964519296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789478636.776075:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e821717d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217184 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478636.776084:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e821717d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8217184 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478636.776124:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964519424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789478636.776154:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478636.776251:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05530180 going to sleep for 11 seconds 00000100:00100000:3.0:1789478636.776265:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964519424 00000100:00100000:3.0:1789478636.776269:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964519424 00000100:00100000:3.0:1789478636.776295:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789478636.776302:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+21:17236:x1876403964519424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789478636.776314:0:17233:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789478636.776325:0:17233:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789478636.776328:0:17233:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1789478636.776389:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+21:17236:x1876403964519424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 86us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478636.776395:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789478636.776424:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964519424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789478636.776546:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789478636.776552:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e821717d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217184 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478636.776568:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e821717d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217184 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478637.797136:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478638.822553:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789478639.269557:0:17274:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789478639.844976:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789478639.845335:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789478639.845340:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789478639.845342:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789478639.845345:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789478639.845372:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789478639.845387:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789478639.845390:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789478639.845393:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789478639.845440:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964519808:0@lo:400:kworker.0 00000100:00100000:2.0:1789478639.845525:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478639.845557:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964520320:0@lo:400:kworker.0 00000100:00100000:2.0:1789478639.845581:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478639.845621:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789478639.845628:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964519936:0@lo:400:kworker.0 00000100:00100000:2.0:1789478639.845652:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478639.845701:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964519808 00000100:00100000:2.0:1789478639.845709:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964519808 00000100:00100000:2.0:1789478639.845744:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964520320 00000100:00100000:2.0:1789478639.845747:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964520320 00000100:00100000:2.0:1789478639.845782:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789478639.845791:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964519808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478639.845841:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964519808:12345-0@lo:400:kworker.0 Request processed in 51us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478639.845849:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789478639.845864:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789478639.845870:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964520320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478639.845898:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964520320:12345-0@lo:400:kworker.0 Request processed in 29us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478639.845904:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789478639.845928:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964519936 00000100:00100000:2.0:1789478639.845937:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964519936 00000100:00100000:2.0:1789478639.845964:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789478639.845970:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964519936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478639.846004:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964519936:12345-0@lo:400:kworker.0 Request processed in 33us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478639.846011:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789478639.846055:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964519936:0@lo:400:kworker.0 00010000:00080000:2.0:1789478639.846069:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc34cb5f80 x1876403964519808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478639.846079:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964519808:0@lo:400:kworker.0 00010000:00080000:2.0:1789478639.846089:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb03f38000 x1876403964520320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478639.846097:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964520320:0@lo:400:kworker.0 00000100:00080000:1.0:1789478639.847174:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789478639.850633:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d53a32c3-7c45-4781-893e-f633d5432f2d:3647:1876403964519552:0@lo:400:kworker.0 00000100:00100000:0.0:1789478639.850714:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478639.850759:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964520064:0@lo:400:kworker.0 00000100:00100000:0.0:1789478639.850782:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478639.850806:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789478639.850812:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964519680:0@lo:400:kworker.0 00000100:00100000:0.0:1789478639.850836:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478639.850852:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964520192:0@lo:400:kworker.0 00000100:00100000:0.0:1789478639.850871:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478639.850906:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964519552 00000100:00100000:0.0:1789478639.850914:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964519552 00000100:00100000:0.0:1789478639.850958:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789478639.850966:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+21:3647:x1876403964519552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478639.851016:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+21:3647:x1876403964519552:12345-0@lo:400:kworker.0 Request processed in 50us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478639.851023:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789478639.851065:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964520064 00000100:00100000:0.0:1789478639.851069:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964520064 00000100:00100000:0.0:1789478639.851093:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964520192 00000100:00100000:0.0:1789478639.851096:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964520192 00000100:00100000:0.0:1789478639.851121:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789478639.851127:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964520064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478639.851157:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964520064:12345-0@lo:400:kworker.0 Request processed in 30us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478639.851162:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789478639.851172:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789478639.851178:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964520192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478639.851201:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964520192:12345-0@lo:400:kworker.0 Request processed in 24us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478639.851207:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1789478639.851220:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789478639.851235:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964519680 00000100:00100000:0.0:1789478639.851239:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964519680 00000100:00100000:0.0:1789478639.851263:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789478639.851269:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964519680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478639.851300:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964519680:12345-0@lo:400:kworker.0 Request processed in 31us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478639.851306:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789478639.851345:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964519680:0@lo:400:kworker.0 00010000:00080000:0.0:1789478639.851357:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb03f39500 x1876403964520192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478639.851368:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964520192:0@lo:400:kworker.0 00000100:00100000:0.0:1789478639.851388:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d53a32c3-7c45-4781-893e-f633d5432f2d:3647:1876403964519552:0@lo:400:kworker.0 00010000:00080000:0.0:1789478639.851398:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebc34cb7100 x1876403964520064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478639.851406:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964520064:0@lo:400:kworker.0 00000001:02000400:3.0:1789478640.643498:0:19110:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789478640.868759:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478640.869622:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789478640.869643:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964520448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478640.869721:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478640.869822:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964520448 00000100:00100000:2.0:1789478640.869830:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964520448 00000100:00100000:2.0:1789478640.869871:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789478640.869879:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964520448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789478640.869908:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789478640.869946:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964520448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478640.869953:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789478640.870111:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964520448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789478641.381757:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789478641.381781:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964520576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789478641.381856:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478641.382049:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964520576 00000100:00100000:1.0:1789478641.382057:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964520576 00000100:00100000:1.0:1789478641.382110:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789478641.382119:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964520576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789478641.382151:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789478641.382200:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964520576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478641.382207:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789478641.382252:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964520576:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1789478641.473131:0:19162:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789478641.473345:0:19162:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789478641.896236:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789478642.091748:0:17992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1789478642.386510:0:19212:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789478642.386890:0:19212:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789478642.923254:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478643.941876:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478644.965261:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789478644.965810:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789478644.965815:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789478644.965818:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789478644.965821:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789478644.965835:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789478644.965838:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789478644.965841:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789478644.965844:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789478644.965907:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964521088:0@lo:400:kworker.0 00000100:00100000:1.0:1789478644.965972:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478644.966025:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789478644.966032:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d53a32c3-7c45-4781-893e-f633d5432f2d:3647:1876403964520704:0@lo:400:kworker.0 00000100:00100000:1.0:1789478644.966059:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478644.966082:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964521216:0@lo:400:kworker.0 00000100:00100000:1.0:1789478644.966112:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478644.966154:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964520832:0@lo:400:kworker.0 00000100:00100000:1.0:1789478644.966178:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478644.966196:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964521344:0@lo:400:kworker.0 00000100:00100000:1.0:1789478644.966220:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478644.966243:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789478644.966249:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964520960:0@lo:400:kworker.0 00000100:00100000:1.0:1789478644.966270:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478644.966286:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964521472:0@lo:400:kworker.0 00000100:00100000:2.0:1789478644.966705:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964520704 00000100:00100000:2.0:1789478644.966719:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964520704 00000100:00100000:2.0:1789478644.966765:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789478644.966775:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+21:3647:x1876403964520704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478644.966830:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+21:3647:x1876403964520704:12345-0@lo:400:kworker.0 Request processed in 57us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478644.966837:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789478644.966870:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964521088 00000100:00100000:2.0:1789478644.966874:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964521088 00000100:00100000:2.0:1789478644.966890:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964520832 00000100:00100000:2.0:1789478644.966892:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964520832 00000100:00100000:2.0:1789478644.966904:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789478644.966910:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964521088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478644.966944:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964521088:12345-0@lo:400:kworker.0 Request processed in 34us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478644.966950:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789478644.966962:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789478644.966968:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964520832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478644.966996:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964520832:12345-0@lo:400:kworker.0 Request processed in 29us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478644.967002:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789478644.968793:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478644.968860:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964520832:0@lo:400:kworker.0 00000100:00100000:0.0:1789478644.969269:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964521216 00000100:00100000:0.0:1789478644.969277:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964521216 00000100:00100000:0.0:1789478644.969324:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964521344 00000100:00100000:0.0:1789478644.969328:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964521344 00000100:00100000:0.0:1789478644.969360:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964520960 00000100:00100000:0.0:1789478644.969363:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964520960 00000100:00100000:0.0:1789478644.969373:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964521472 00000100:00100000:0.0:1789478644.969375:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964521472 00000100:00100000:0.0:1789478644.969390:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789478644.969397:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964521216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478644.969453:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964521216:12345-0@lo:400:kworker.0 Request processed in 57us (3340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478644.969460:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789478644.969475:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789478644.969481:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964521344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478644.969509:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964521344:12345-0@lo:400:kworker.0 Request processed in 28us (3288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478644.969514:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789478644.969535:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789478644.969541:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964520960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478644.969587:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964520960:12345-0@lo:400:kworker.0 Request processed in 46us (3316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478644.969613:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789478644.969625:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789478644.969631:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964521472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478644.969674:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964521472:12345-0@lo:400:kworker.0 Request processed in 43us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478644.969680:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789478644.969894:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789478644.969898:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789478644.970821:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d53a32c3-7c45-4781-893e-f633d5432f2d:3647:1876403964520704:0@lo:400:kworker.0 00010000:00080000:1.0:1789478644.970839:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb03fffb80 x1876403964521216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478644.970849:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964521216:0@lo:400:kworker.0 00000100:00100000:1.0:1789478644.970862:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964521088:0@lo:400:kworker.0 00010000:00080000:1.0:1789478644.970899:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb037e7b80 x1876403964520960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478644.970921:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964520960:0@lo:400:kworker.0 00010000:00080000:1.0:1789478644.970935:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb03ffc700 x1876403964521472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478644.970942:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964521472:0@lo:400:kworker.0 00010000:00080000:1.0:1789478644.970951:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb03ffe300 x1876403964521344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478644.970958:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964521344:0@lo:400:kworker.0 00000100:00100000:0.0:1789478645.097225:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789478630/real 1789478630] req@ffff8ebb03598380 x1876403964513536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789478645 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478645.097254:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ebb03598380 x1876403964513536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789478645 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478645.097264:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789478630/real 1789478630] req@ffff8ebb0359ad80 x1876403964513664/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789478645 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478645.097274:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ebb0359ad80 x1876403964513664/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789478645 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789478645.097294:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc34e1f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789478645.097312:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789478645.097316:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964513536:0@lo:8:kworker.0 00000100:00080000:0.0:1789478645.097321:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc1897e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789478645.097326:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789478645.097328:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964513664:0@lo:8:kworker.0 00000100:00080000:1.0:1789478645.097845:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789478645.097855:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789478645.097859:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789478645.097862:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789478645.097865:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789478645.097867:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789478645.097871:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ebc34e1f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789478645.097877:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 459 00000100:00080000:1.0:1789478645.097882:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789478645.097897:0:37:0:(import.c:625:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ebc34e1f800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1789478645.097926:0:37:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb03ffe300 x1876403964521600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789478645.097952:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789478645.097955:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789478645.097963:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ebc1897e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789478645.097966:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 459 00000100:00080000:1.0:1789478645.097969:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789478645.097974:0:37:0:(import.c:625:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ebc1897e000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1789478645.097987:0:37:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb03ffc700 x1876403964521728/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789478645.098014:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964521600:0@lo:8:kworker.0 00000100:00100000:0.0:1789478645.098072:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478645.098115:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964521728:0@lo:8:kworker.0 00000100:00100000:0.0:1789478645.098146:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478645.098175:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964521600 00000100:00100000:3.0:1789478645.098182:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964521600 00000100:00100000:3.0:1789478645.098217:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964521728 00000100:00100000:3.0:1789478645.098221:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964521728 00000100:00100000:3.0:1789478645.098233:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789478645.098240:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03feca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1876403964521600:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789478645.098271:0:18747:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:3.0:1789478645.098295:0:18747:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8ebaae74e821718b 00002000:00100000:3.0:1789478645.098307:0:18747:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8ebb01b7f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789478645.098311:0:18747:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1789478645.098313:0:18747:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789478645.098532:0:18747:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789478645.098553:0:18747:0:(import.c:65:import_set_state_nolock()) ffff8ebb01b7e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789478645.098636:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03feca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1876403964521600:12345-0@lo:8:kworker.0 Request processed in 395us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478645.098649:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789478645.098676:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789478645.098681:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1876403964521728:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789478645.098836:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb03ffe300 x1876403964521600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789478665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478645.098845:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789478645.098852:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789478645.098858:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789478645.098863:0:3644:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789478645.098865:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc34e1f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789478645.098887:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789478645.098892:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964521600:0@lo:8:kworker.0 00000004:00080000:2.0:1789478645.098997:0:17980:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789478645.099018:0:17980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f38e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17980:1876403964521984:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789478645.099050:0:17980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478645.099067:0:17980:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08c7de40 going to sleep for 11 seconds 00000100:00100000:2.0:1789478645.099079:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789478645.099096:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964521856:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789478645.099135:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478645.099161:0:18746:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789478645.099167:0:18746:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789478645.099255:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964521984 00000100:00100000:1.0:1789478645.099256:0:18748:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789478645.099259:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964521984 00000100:00080000:2.0:1789478645.099293:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789478645.099352:0:19341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789478645.099360:0:19341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17980:x1876403964521984:12345-0@lo:7:osp-pre-0-1.0 00010000:00020000:3.0:1789478645.099374:0:18747:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789478645.099984:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964521856 00000100:00100000:0.0:1789478645.099999:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964521856 00000100:00100000:0.0:1789478645.100037:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789478645.100045:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1876403964521856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789478645.100064:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789478645.100134:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1876403964521856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478645.100141:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789478645.100155:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb03f3b480 x1876403964521856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478661 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478645.100172:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964521856:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1789478645.101731:0:17979:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789478645.101811:0:17979:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 474217216757ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789478645.101818:0:17979:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1789478645.111527:0:17971:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:2.0:1789478645.117456:0:19341:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1789478645.117466:0:19341:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789478645.117569:0:19341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17980:x1876403964521984:12345-0@lo:7:osp-pre-0-1.0 Request processed in 18207us (18515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478645.117580:0:19341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789478645.117698:0:17980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb03f38e00 x1876403964521984/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789478661 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478645.117727:0:17980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f38e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17980:1876403964521984:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789478645.117742:0:17980:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789478645.117781:0:17980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fee300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17980:1876403964522112:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789478645.117816:0:17980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478645.117850:0:17980:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40e86f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789478645.117902:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964522112 00000100:00100000:2.0:1789478645.117908:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964522112 00000100:00100000:2.0:1789478645.117961:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789478645.117970:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17980:x1876403964522112:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1789478645.118001:0:18746:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1789478645.118039:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17980:x1876403964522112:12345-0@lo:5:osp-pre-0-1.0 Request processed in 70us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478645.118044:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789478645.118096:0:17980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb03fee300 x1876403964522112/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789478661 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478645.118105:0:17980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fee300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17980:1876403964522112:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789478645.118112:0:17980:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789478645.118131:0:17980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fee300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17980:1876403964522240:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789478645.118150:0:17980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478645.118171:0:17980:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40e86f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789478645.118262:0:19341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964522240 00000100:00100000:2.0:1789478645.118267:0:19341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964522240 00000100:00100000:2.0:1789478645.118329:0:19341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789478645.118337:0:19341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17980:x1876403964522240:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1789478645.118361:0:19341:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1789478645.132821:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1876403964521728:12345-0@lo:8:kworker.0 Request processed in 34129us (34664us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789478645.132841:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789478645.132890:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc1897e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789478645.132897:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789478645.132913:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964521728:0@lo:8:kworker.0 00000001:00080000:1.0:1789478645.153554:0:18742:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1789478645.153568:0:18742:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1789478645.154209:0:19341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17980:x1876403964522240:12345-0@lo:5:osp-pre-0-1.0 Request processed in 35867us (36051us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789478645.154222:0:19341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789478645.154244:0:17980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb03fee300 x1876403964522240/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789478661 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478645.154256:0:17980:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789478645.154264:0:17980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fee300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17980:1876403964522240:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1789478645.154279:0:17980:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1789478645.154334:0:17980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17980:1876403964522368:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789478645.154365:0:17980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478645.154395:0:17980:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34f72900 going to sleep for 11 seconds 00000100:00100000:1.0:1789478645.154497:0:17250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964522368 00000100:00100000:1.0:1789478645.154504:0:17250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964522368 00000100:00100000:1.0:1789478645.154546:0:17250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789478645.154555:0:17250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17980:x1876403964522368:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789478645.154628:0:17250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17980:x1876403964522368:12345-0@lo:900:osp-pre-0-1.0 Request processed in 74us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478645.154633:0:17250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789478645.154698:0:17980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb0359b480 x1876403964522368/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789478661 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478645.154708:0:17980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17980:1876403964522368:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1789478645.990773:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478645.993916:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964522496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478645.993981:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478645.999640:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964522496 00000100:00100000:0.0:1789478645.999664:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964522496 00000100:00100000:0.0:1789478645.999719:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789478645.999729:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964522496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789478645.999763:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789478646.001331:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964522496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1597us (7343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478646.001343:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789478646.001462:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964522496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789478646.500790:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964522624:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789478646.500859:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478646.501083:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964522624 00000100:00100000:1.0:1789478646.501091:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964522624 00000100:00100000:1.0:1789478646.501159:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789478646.501168:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0359b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964522624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789478646.501213:0:17243:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789478646.501268:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0359b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964522624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478646.501275:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789478646.501316:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964522624:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789478647.015213:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478648.036791:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789478648.720051:0:19558:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789478648.720055:0:19558:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789478648.720057:0:19558:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789478648.720205:0:19558:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ebb01b7d000 00000020:01000004:3.0:1789478648.720222:0:19558:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789478648.720239:0:19558:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789478648.720261:0:19558:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8ebb03274d28) 00000020:00000080:3.0:1789478648.720278:0:19558:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789478648.765589:0:19558:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789478648.770435:0:19558:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789478648.770804:0:19558:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789478648.771247:0:19558:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789478648.771475:0:19558:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789478648.771809:0:19558:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789478648.772043:0:19558:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:0.0:1789478648.773049:0:19558:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789478648.773254:0:19558:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789478648.773267:0:19558:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789478648.773279:0:19558:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8ebaae74e8217199 00000020:01000004:0.0:1789478648.773286:0:19558:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789478648.773308:0:19558:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.111@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789478648.773312:0:19558:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789478648.773317:0:19558:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789478648.773346:0:19558:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1789478648.773350:0:19558:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.111@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789478648.794663:0:19558:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789478648.794722:0:19558:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.111@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789478648.794726:0:19558:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789478648.794728:0:19558:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789478648.794730:0:19558:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478648.794731:0:19558:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478648.794732:0:19558:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478648.794734:0:19558:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478648.794735:0:19558:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789478648.794737:0:19558:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478648.794738:0:19558:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789478648.794742:0:19558:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789478648.794744:0:19558:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789478648.794746:0:19558:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789478648.794747:0:19558:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478648.794748:0:19558:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478648.794749:0:19558:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478648.794750:0:19558:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478648.794751:0:19558:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789478648.794752:0:19558:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478648.794753:0:19558:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789478648.794782:0:19558:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789478648.794802:0:19558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f39f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964522752:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789478648.794874:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478648.794920:0:19558:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40e86cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478648.795967:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964522752 00000100:00100000:0.0:1789478648.795978:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964522752 00000100:00100000:0.0:1789478648.796036:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789478648.796046:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc0a5f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+21:19558:x1876403964522752:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789478648.796078:0:17233:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789478648.796081:0:17233:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789478648.796085:0:17233:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789478648.796925:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc0a5f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+21:19558:x1876403964522752:12345-0@lo:253:mount.lustre.0 Request processed in 876us (2046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478648.796938:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789478648.797031:0:19558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f39f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964522752:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789478648.797046:0:19558:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789478648.797049:0:19558:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789478648.797063:0:19558:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789478648.797064:0:19558:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789478648.797065:0:19558:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789478648.797067:0:19558:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789478648.797068:0:19558:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789478648.797069:0:19558:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789478648.797071:0:19558:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789478648.797072:0:19558:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789478648.797093:0:19558:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ebb01b7d000 from lustre-OST0001 10000000:01000000:2.0:1789478648.797124:0:19558:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789478648.797127:0:19558:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789478648.797136:0:19558:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ebc40f719b8 local copy 00010000:00010000:2.0:1789478648.797160:0:19558:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216eb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216eba expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478648.797261:0:19558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f39f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964522880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789478648.797297:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478648.797330:0:19558:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03751f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789478648.797458:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964522880 00000100:00100000:0.0:1789478648.797464:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964522880 00000100:00100000:0.0:1789478648.797509:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789478648.797516:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc02eac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+21:19558:x1876403964522880:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789478648.797582:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc02eac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+21:19558:x1876403964522880:12345-0@lo:501:mount.lustre.0 Request processed in 66us (284us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789478648.797589:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789478648.797939:0:19558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f39f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964522880:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789478648.797953:0:19558:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789478648.797970:0:19558:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789478648.797976:0:19558:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216eb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216eba expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.797985:0:19558:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebb035fde00/0x8ebaae74e8216eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8216eba expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478648.798013:0:19558:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ebb01b7d000 10000000:01000000:2.0:1789478648.798018:0:19558:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789478648.798022:0:19558:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789478648.798024:0:19558:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789478648.798034:0:19558:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789478648.798037:0:19558:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789478648.798057:0:19558:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76400/0x8ebaae74e82171a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.798064:0:19558:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76400/0x8ebaae74e82171a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.798072:0:19558:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76400/0x8ebaae74e82171a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478648.798085:0:19558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f39f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964523008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789478648.798112:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478648.798151:0:19558:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebb03751f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789478648.798237:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964523008 00000100:00100000:0.0:1789478648.798241:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964523008 00000100:00100000:0.0:1789478648.798275:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789478648.798282:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc02eaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+21:19558:x1876403964523008:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789478648.798291:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478648.798303:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40f04800/0x8ebaae74e82171a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e82171a0 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478648.798321:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40f04800/0x8ebaae74e82171a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e82171a0 expref: 22 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478648.798330:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40f04800/0x8ebaae74e82171a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e82171a0 expref: 22 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478648.798338:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40f04800, rc 0) 00000100:00100000:0.0:1789478648.798454:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc02eaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+22:19558:x1876403964523008:12345-0@lo:101:mount.lustre.0 Request processed in 172us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478648.798460:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789478648.798568:0:19558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f39f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964523008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789478648.798581:0:19558:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76400/0x8ebaae74e82171a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82171a7 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478648.798589:0:19558:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76400/0x8ebaae74e82171a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e82171a7 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789478648.799916:0:19558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789478648.800469:0:19558:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789478648.803027:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789478648.803078:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789478648.803093:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789478648.803106:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789478648.803119:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789478648.803132:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789478648.806873:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789478648.806895:0:19558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789478648.807007:0:19558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964523136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789478648.807260:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478648.807353:0:19558:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc094f9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789478648.811905:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964523136 00000100:00100000:2.0:1789478648.811918:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964523136 00000100:00100000:2.0:1789478648.812011:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789478648.812022:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc1a62f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+22:19558:x1876403964523136:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789478648.812215:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc1a62f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+22:19558:x1876403964523136:12345-0@lo:501:mount.lustre.0 Request processed in 195us (4954us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478648.812224:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789478648.812310:0:19558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964523136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789478648.812360:0:19558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964523264:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789478648.812412:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478648.815207:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964523264 00000100:00100000:0.0:1789478648.815219:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964523264 00000100:00100000:0.0:1789478648.815265:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789478648.815274:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc1a62fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+22:19558:x1876403964523264:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789478648.816853:0:19558:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc094f9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789478648.819984:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc1a62fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+22:19558:x1876403964523264:12345-0@lo:503:mount.lustre.0 Request processed in 4702us (7562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478648.819998:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789478648.825020:0:19558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964523264:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789478648.825697:0:19558:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789478648.825817:0:19558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964523392:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789478648.825894:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478648.825927:0:19558:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34f72d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789478648.826250:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964523392 00000100:00100000:2.0:1789478648.826258:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964523392 00000100:00100000:2.0:1789478648.826310:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789478648.826319:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+22:19558:x1876403964523392:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789478648.826931:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+22:19558:x1876403964523392:12345-0@lo:502:mount.lustre.0 Request processed in 611us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478648.826949:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789478648.827074:0:19558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964523392:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789478648.827387:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789478648.827415:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789478648.827430:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789478648.827442:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789478648.827454:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789478648.827465:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789478648.827477:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789478648.827488:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789478648.827499:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789478648.827530:0:19558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964523520:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789478648.827571:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478648.827694:0:19558:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34f72d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789478648.830364:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964523520 00000100:00100000:0.0:1789478648.830377:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964523520 00000100:00100000:0.0:1789478648.830439:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789478648.830449:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+22:19558:x1876403964523520:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789478648.830630:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+22:19558:x1876403964523520:12345-0@lo:502:mount.lustre.0 Request processed in 181us (3057us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478648.830647:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789478648.831277:0:19558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964523520:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789478648.831358:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789478648.831372:0:19558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1789478648.832290:0:19562:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789478648.832298:0:19562:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1789478648.832304:0:19562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478648.832306:0:19562:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789478648.832311:0:19562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789478648.832325:0:19562:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8ebc08d94d28) 00000020:00000080:0.0:1789478648.832348:0:19562:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789478648.832354:0:19562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789478648.832436:0:19562:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ebb01b7d000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789478648.832445:0:19562:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789478648.832452:0:19562:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8ebaae74e82171b5 00010000:00010000:1.0:1789478648.839405:0:19562:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1789478648.840036:0:19562:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1789478648.841435:0:19562:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1789478648.846959:0:19562:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789478648.846972:0:19562:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789478648.846979:0:19562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478648.846981:0:19562:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789478648.846987:0:19562:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789478648.846991:0:19562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478648.846992:0:19562:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789478648.846995:0:19562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789478648.846997:0:19562:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789478648.846999:0:19562:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789478648.847002:0:19562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478648.847003:0:19562:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789478648.847006:0:19562:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789478648.847008:0:19562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478648.847009:0:19562:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789478648.847013:0:19562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789478648.847043:0:19562:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789478648.847045:0:19562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789478648.847046:0:19562:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789478648.847049:0:19562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1789478648.847304:0:19558:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789478648.847333:0:19558:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789478648.847359:0:19558:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76400/0x8ebaae74e82171a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82171a7 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.847371:0:19558:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76400/0x8ebaae74e82171a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82171a7 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478648.847379:0:19558:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebb01b7d000 from 1 10000000:01000000:2.0:1789478648.847382:0:19558:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789478648.847416:0:19558:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e82171bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.847423:0:19558:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e82171bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.847434:0:19558:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e82171bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478648.847457:0:19558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964523648:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789478648.847521:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478648.847566:0:19558:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc07f51f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789478648.847833:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964523648 00000100:00100000:1.0:1789478648.847841:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964523648 00000100:00100000:1.0:1789478648.847891:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789478648.847900:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+22:19558:x1876403964523648:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789478648.847923:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478648.847938:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc08c4a600/0x8ebaae74e82171c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e82171bc expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478648.847959:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc08c4a600/0x8ebaae74e82171c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e82171bc expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478648.847969:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc08c4a600/0x8ebaae74e82171c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e82171bc expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478648.847977:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4a600, rc 0) 00000100:00100000:1.0:1789478648.848016:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+23:19558:x1876403964523648:12345-0@lo:101:mount.lustre.0 Request processed in 118us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478648.848022:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789478648.848303:0:19558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964523648:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789478648.848320:0:19558:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e82171bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82171c3 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.848329:0:19558:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e82171bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e82171c3 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789478648.849494:0:19558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789478648.850462:0:19558:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789478648.851920:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789478648.851964:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789478648.851987:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789478648.851993:0:19558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789478648.852092:0:19558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964523776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789478648.853317:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478648.853416:0:19558:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc07f51cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478648.855293:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964523776 00000100:00100000:1.0:1789478648.855304:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964523776 00000100:00100000:1.0:1789478648.855360:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789478648.855372:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+23:19558:x1876403964523776:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789478648.855545:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+23:19558:x1876403964523776:12345-0@lo:501:mount.lustre.0 Request processed in 175us (2232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478648.855554:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789478648.856819:0:19558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964523776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789478648.856876:0:19558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964523904:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789478648.856939:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478648.856983:0:19558:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc182a6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789478648.857936:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964523904 00000100:00100000:1.0:1789478648.857945:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964523904 00000100:00100000:1.0:1789478648.857991:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789478648.857999:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+23:19558:x1876403964523904:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789478648.858272:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+23:19558:x1876403964523904:12345-0@lo:503:mount.lustre.0 Request processed in 273us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478648.858291:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789478648.858379:0:19558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964523904:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789478648.859360:0:19558:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789478648.859467:0:19558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964524032:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789478648.859530:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478648.859575:0:19558:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc100433c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478648.860879:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964524032 00000100:00100000:1.0:1789478648.860891:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964524032 00000100:00100000:1.0:1789478648.860937:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789478648.860947:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+23:19558:x1876403964524032:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789478648.861087:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+23:19558:x1876403964524032:12345-0@lo:502:mount.lustre.0 Request processed in 141us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478648.861094:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789478648.861248:0:19558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964524032:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789478648.861449:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789478648.861476:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789478648.861496:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789478648.861508:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789478648.861518:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789478648.861529:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789478648.861539:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789478648.861549:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1789478648.861559:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789478648.861569:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1789478648.861580:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1789478648.861658:0:19558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964524160:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789478648.861701:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478648.864465:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964524160 00000100:00100000:0.0:1789478648.864476:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964524160 00000100:00100000:0.0:1789478648.864527:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789478648.864537:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+23:19558:x1876403964524160:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789478648.864735:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+23:19558:x1876403964524160:12345-0@lo:502:mount.lustre.0 Request processed in 199us (3032us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478648.864750:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789478648.865002:0:19558:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc04fca300 going to sleep for 11 seconds 00000100:00100000:0.0:1789478648.865027:0:19558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964524160:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789478648.865105:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1789478648.865117:0:19558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789478648.866256:0:19566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789478648.866267:0:19566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478648.866269:0:19566:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789478648.866276:0:19566:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ebb01b7d000 00000020:00000080:0.0:1789478648.866279:0:19566:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789478648.866286:0:19566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789478648.866289:0:19566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478648.866291:0:19566:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789478648.866293:0:19566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789478648.866295:0:19566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478648.866296:0:19566:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789478648.866300:0:19566:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ebb01b7d000 00000020:00000080:0.0:1789478648.866301:0:19566:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789478648.866399:0:19566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789478648.866403:0:19566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478648.866405:0:19566:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789478648.866407:0:19566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789478648.866410:0:19566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478648.866411:0:19566:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789478648.866415:0:19566:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ebb01b7d000 00000020:00000080:0.0:1789478648.866416:0:19566:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789478648.867931:0:19566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789478648.867941:0:19566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478648.867943:0:19566:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789478648.867946:0:19566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789478648.867949:0:19566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478648.867956:0:19566:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789478648.867961:0:19566:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ebb01b7d000 00000020:00000080:0.0:1789478648.867963:0:19566:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789478648.868008:0:19566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789478648.868011:0:19566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789478648.868012:0:19566:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789478648.868015:0:19566:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1789478648.868819:0:19558:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789478648.868859:0:19558:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789478648.868877:0:19558:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e82171bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82171c3 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.868889:0:19558:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e82171bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82171c3 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478648.868945:0:19558:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789478648.868949:0:19558:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ebb01b7d000 10000000:01000000:2.0:1789478648.868952:0:19558:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ebb01b7d000 10000000:01000000:2.0:1789478648.868956:0:19558:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789478648.868961:0:19558:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ebb01b7d000 from 1 10000000:01000000:2.0:1789478648.868963:0:19558:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789478648.868998:0:19558:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77e00/0x8ebaae74e82171ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.869007:0:19558:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77e00/0x8ebaae74e82171ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.869031:0:19558:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77e00/0x8ebaae74e82171ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478648.869059:0:19558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964524288:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789478648.869124:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478648.869160:0:19558:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc07f51780 going to sleep for 11 seconds 00000100:00100000:0.0:1789478648.870284:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964524288 00000100:00100000:0.0:1789478648.870295:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964524288 00000100:00100000:0.0:1789478648.870356:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789478648.870367:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+23:19558:x1876403964524288:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789478648.870382:0:17232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478648.870400:0:17232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40f04200/0x8ebaae74e82171d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e82171ca expref: -99 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478648.870425:0:17232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40f04200/0x8ebaae74e82171d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e82171ca expref: 24 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478648.870436:0:17232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40f04200/0x8ebaae74e82171d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e82171ca expref: 24 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478648.870444:0:17232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40f04200, rc 0) 00000100:00100000:0.0:1789478648.870498:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+24:19558:x1876403964524288:12345-0@lo:101:mount.lustre.0 Request processed in 134us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478648.870505:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789478648.871867:0:19558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964524288:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789478648.871892:0:19558:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77e00/0x8ebaae74e82171ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82171d1 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.871904:0:19558:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77e00/0x8ebaae74e82171ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e82171d1 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789478648.875250:0:19558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1789478648.875535:0:19558:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789478648.876060:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789478648.876088:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789478648.876102:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789478648.876115:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789478648.876128:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789478648.876828:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789478648.876858:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789478648.876872:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789478648.876884:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789478648.876903:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789478648.876916:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789478648.876929:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789478648.876955:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789478648.876970:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789478648.876991:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789478648.877005:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789478648.877018:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789478648.877029:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789478648.877039:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789478648.877050:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789478648.877061:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789478648.877071:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789478648.877085:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789478648.877099:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789478648.877112:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1789478648.877124:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1789478648.877135:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1789478648.878934:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1789478648.878977:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1789478648.878993:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1789478648.879005:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1789478648.879018:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1789478648.879030:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1789478648.879042:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1789478648.879054:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1789478648.879067:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1789478648.879078:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1789478648.879091:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1789478648.879104:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1789478648.879116:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1789478648.879128:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1789478648.880830:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1789478648.880876:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1789478648.880889:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1789478648.880916:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1789478648.880929:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1789478648.880955:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1789478648.880967:0:19558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1789478648.881065:0:19558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964524416:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789478648.881129:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478648.881185:0:19558:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc07f51f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789478648.881288:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964524416 00000100:00100000:3.0:1789478648.881296:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964524416 00000100:00100000:3.0:1789478648.881348:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789478648.881358:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+24:19558:x1876403964524416:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789478648.881475:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+24:19558:x1876403964524416:12345-0@lo:501:mount.lustre.0 Request processed in 119us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478648.881482:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789478648.884521:0:19558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964524416:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789478648.884578:0:19558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964524544:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789478648.884688:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478648.885288:0:19558:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc07f51f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789478648.885372:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964524544 00000100:00100000:1.0:1789478648.885380:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964524544 00000100:00100000:1.0:1789478648.885439:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789478648.885448:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+24:19558:x1876403964524544:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789478648.885574:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+24:19558:x1876403964524544:12345-0@lo:503:mount.lustre.0 Request processed in 126us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478648.885582:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789478648.886849:0:19558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964524544:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789478648.887330:0:19558:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789478648.887409:0:19558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964524672:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789478648.887474:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478648.887519:0:19558:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc07f51780 going to sleep for 11 seconds 00000100:00100000:0.0:1789478648.888321:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964524672 00000100:00100000:0.0:1789478648.888331:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964524672 00000100:00100000:0.0:1789478648.888380:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789478648.888389:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+24:19558:x1876403964524672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789478648.888518:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+24:19558:x1876403964524672:12345-0@lo:502:mount.lustre.0 Request processed in 129us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478648.888531:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789478648.888794:0:19558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964524672:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789478648.888998:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789478648.889027:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789478648.889043:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789478648.889057:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789478648.889070:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789478648.889082:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789478648.889094:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789478648.889105:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789478648.889117:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789478648.889130:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789478648.890462:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789478648.890507:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789478648.890525:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789478648.890547:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789478648.890560:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789478648.890573:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789478648.890588:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789478648.891850:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789478648.891869:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789478648.891883:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789478648.891897:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789478648.891911:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789478648.891924:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789478648.891940:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789478648.891955:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1789478648.891970:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1789478648.891986:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1789478648.892019:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1789478648.892036:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1789478648.892051:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1789478648.892065:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1789478648.892079:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1789478648.892093:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1789478648.892107:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1789478648.892121:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1789478648.892135:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1789478648.893866:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1789478648.893889:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1789478648.893903:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1789478648.893917:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1789478648.893932:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1789478648.893946:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1789478648.893961:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1789478648.893991:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1789478648.894007:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1789478648.894020:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1789478648.894048:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1789478648.894063:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1789478648.894118:0:19558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964524800:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789478648.895392:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478648.897090:0:19558:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc07f51780 going to sleep for 11 seconds 00000100:00100000:3.0:1789478648.902267:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964524800 00000100:00100000:3.0:1789478648.902282:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964524800 00000100:00100000:3.0:1789478648.902346:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789478648.902357:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+24:19558:x1876403964524800:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789478648.902519:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+24:19558:x1876403964524800:12345-0@lo:502:mount.lustre.0 Request processed in 164us (7129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478648.902527:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789478648.902675:0:19558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964524800:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789478648.904220:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1789478648.904254:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1789478648.904297:0:19558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964524928:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789478648.904362:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478648.904398:0:19558:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc07f51780 going to sleep for 11 seconds 00000100:00100000:0.0:1789478648.904480:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964524928 00000100:00100000:0.0:1789478648.904487:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964524928 00000100:00100000:0.0:1789478648.904533:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789478648.904541:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+24:19558:x1876403964524928:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789478648.905959:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+24:19558:x1876403964524928:12345-0@lo:502:mount.lustre.0 Request processed in 1413us (1591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478648.905971:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789478648.906280:0:19558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964524928:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789478648.906354:0:19558:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1789478648.906366:0:19558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789478648.908343:0:19571:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789478648.908361:0:19571:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8ebb03270000) 00000020:00000080:3.0:1789478648.908388:0:19571:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1789478648.908485:0:19571:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ebb01b7d000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789478648.908490:0:19571:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ebb01b7d000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789478648.908492:0:19571:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ebb01b7d000 3 00010000:00080000:3.0:1789478648.908530:0:19571:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ebb02058000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.111@tcp at head 00010000:00010000:3.0:1789478648.913416:0:19571:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1789478648.915837:0:19571:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789478648.915888:0:19571:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789478648.915902:0:19571:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8ebaae74e82171df 00000100:00080000:2.0:1789478648.915913:0:19571:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789478648.915923:0:19571:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ebb02058000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1789478648.915955:0:19571:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb03f3bb80 x1876403964525056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789478648.915983:0:19571:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789478648.916787:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876403964525056:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789478648.916849:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478648.917045:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964525056 00000100:00100000:2.0:1789478648.917052:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964525056 00000100:00100000:2.0:1789478648.917092:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789478648.917099:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876403964525056:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789478648.917122:0:17238:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:2.0:1789478648.917179:0:17238:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8ebaae74e82171e6 00000004:00100000:2.0:1789478648.917193:0:17238:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789478648.917222:0:17238:0:(import.c:65:import_set_state_nolock()) ffff8ebb01b63800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789478648.917277:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876403964525056:12345-0@lo:38:llog_process_th.0 Request processed in 178us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478648.917285:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789478648.917322:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb03f3bb80 x1876403964525056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789478658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478648.917331:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789478648.917338:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789478648.917344:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789478648.917348:0:3644:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789478648.917350:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebb02058000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789478648.917355:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876403964525056:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789478648.917690:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789478648.917694:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789478648.917696:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789478648.917699:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789478648.917801:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789478648.917804:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789478648.917807:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ebc1897e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789478648.917811:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 474 00000100:00080000:2.0:1789478648.917814:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789478648.917821:0:37:0:(import.c:625:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ebc1897e000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1789478648.917835:0:37:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb03f3ad80 x1876403964525696/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789478648.917874:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964525568:0@lo:400:kworker.0 00000100:00100000:2.0:1789478648.917911:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478648.917934:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789478648.917939:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964525184:0@lo:400:kworker.0 00000100:00100000:2.0:1789478648.917960:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478648.917975:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964525824:0@lo:400:kworker.0 00000100:00100000:2.0:1789478648.917992:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478648.918014:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964525440:0@lo:400:kworker.0 00000100:00100000:2.0:1789478648.918033:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478648.918047:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876403964526080:0@lo:400:kworker.0 00000100:00100000:2.0:1789478648.918063:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478648.918078:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789478648.918083:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876403964525312:0@lo:400:kworker.0 00000100:00100000:2.0:1789478648.918102:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478648.918115:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876403964525952:0@lo:400:kworker.0 00000100:00100000:2.0:1789478648.918131:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478648.918269:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964525568 00000100:00100000:2.0:1789478648.918275:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964525568 00000100:00100000:2.0:1789478648.918356:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789478648.918365:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964525568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478648.918404:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964525568:12345-0@lo:400:kworker.0 Request processed in 41us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478648.918410:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789478648.919447:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964525184 00000100:00100000:3.0:1789478648.919457:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964525184 00000100:00100000:3.0:1789478648.919488:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964525440 00000100:00100000:3.0:1789478648.919491:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964525440 00000100:00100000:3.0:1789478648.919509:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789478648.919519:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964525184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478648.919585:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964525184:12345-0@lo:400:kworker.0 Request processed in 69us (1622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478648.919591:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789478648.919628:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789478648.919643:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964525440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478648.919682:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964525440:12345-0@lo:400:kworker.0 Request processed in 48us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478648.919688:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789478648.919730:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964525440:0@lo:400:kworker.0 00000100:00100000:0.0:1789478648.919984:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964525824 00000100:00100000:0.0:1789478648.919989:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964525824 00000100:00100000:0.0:1789478648.920010:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964526080 00000100:00100000:0.0:1789478648.920013:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964526080 00000100:00100000:0.0:1789478648.920029:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964525312 00000100:00100000:0.0:1789478648.920032:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964525312 00000100:00100000:0.0:1789478648.920044:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964525952 00000100:00100000:0.0:1789478648.920046:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964525952 00000100:00100000:0.0:1789478648.920063:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789478648.920069:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964525824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478648.920106:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964525824:12345-0@lo:400:kworker.0 Request processed in 38us (2113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478648.920113:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789478648.920125:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789478648.920132:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876403964526080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478648.920180:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876403964526080:12345-0@lo:400:kworker.0 Request processed in 48us (2114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478648.920186:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789478648.920197:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789478648.920212:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876403964525312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478648.920241:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876403964525312:12345-0@lo:400:kworker.0 Request processed in 30us (2138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478648.920246:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789478648.920258:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789478648.920265:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876403964525952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478648.920289:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876403964525952:12345-0@lo:400:kworker.0 Request processed in 25us (2157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478648.920295:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1789478648.920323:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb03f38a80 x1876403964525312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478648.920334:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876403964525312:0@lo:400:kworker.0 00010000:00080000:0.0:1789478648.920346:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb03f38380 x1876403964525952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478648.920353:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876403964525952:0@lo:400:kworker.0 00010000:00080000:0.0:1789478648.920366:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb03f39c00 x1876403964526080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478648.920372:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876403964526080:0@lo:400:kworker.0 00000020:01000004:0.0:1789478648.921985:0:19571:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789478648.922001:0:19571:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8ebc08d90000) 00000020:00000080:0.0:1789478648.922025:0:19571:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1789478648.922114:0:19571:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ebb01b7d000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789478648.922117:0:19571:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ebb01b7d000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789478648.922120:0:19571:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ebb01b7d000 3 00010000:00080000:0.0:1789478648.922321:0:19571:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ebc34c6b000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.111@tcp at head 00000100:00080000:2.0:1789478648.923800:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789478648.923876:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789478648.923881:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789478648.923959:0:19571:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1789478648.924137:0:19571:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1789478648.924178:0:19571:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789478648.924190:0:19571:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x8ebaae74e82171f4 00000100:00080000:0.0:1789478648.924199:0:19571:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789478648.924208:0:19571:0:(import.c:625:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8ebc34c6b000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1789478648.924229:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964525184:0@lo:400:kworker.0 00000100:00100000:0.0:1789478648.924240:0:19571:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebb03fed500 x1876403964526208/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789478648.924254:0:19571:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00010000:00080000:2.0:1789478648.924783:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb03f3a300 x1876403964525824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478648.924794:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964525824:0@lo:400:kworker.0 00000100:00100000:1.0:1789478648.924888:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964525696:0@lo:8:kworker.0 00000100:00100000:1.0:1789478648.924948:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478648.924975:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876403964526208:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789478648.924998:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478648.925034:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964526208 00000100:00100000:1.0:1789478648.925039:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964526208 00000100:00100000:1.0:1789478648.925065:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789478648.925072:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876403964526208:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789478648.925100:0:17238:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:1.0:1789478648.925126:0:17238:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x8ebaae74e82171fb 00000004:00100000:1.0:1789478648.925152:0:17238:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789478648.925177:0:17238:0:(import.c:65:import_set_state_nolock()) ffff8ebb02697000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789478648.925217:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876403964526208:12345-0@lo:38:llog_process_th.0 Request processed in 144us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478648.925224:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789478648.925248:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb03fed500 x1876403964526208/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789478658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478648.925256:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789478648.925262:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789478648.925267:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789478648.925271:0:3644:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789478648.925273:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc34c6b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789478648.925278:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876403964526208:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789478648.925922:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ebb03f3b800 x1876403964525568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478648.925997:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964525568:0@lo:400:kworker.0 00000100:00080000:2.0:1789478648.926035:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789478648.926040:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789478648.926043:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789478648.926046:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789478648.927111:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964525696 00000100:00100000:0.0:1789478648.927120:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964525696 00000100:00100000:0.0:1789478648.927168:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789478648.927176:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1876403964525696:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789478648.927255:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1876403964525696:12345-0@lo:8:kworker.0 Request processed in 79us (2307us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789478648.927263:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789478648.927326:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789478648.927334:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc1897e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789478648.927338:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789478648.927341:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964525696:0@lo:8:kworker.0 00000040:00080000:0.0:1789478648.927456:0:19571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1789478648.927560:0:19558:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789478648.927590:0:19558:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789478648.928002:0:19558:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77e00/0x8ebaae74e82171ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82171d1 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478648.928013:0:19558:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77e00/0x8ebaae74e82171ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e82171d1 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789478648.928069:0:19558:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789478648.928071:0:19558:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789478648.928073:0:19558:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789478648.928074:0:19558:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789478648.928075:0:19558:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789478648.928077:0:19558:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789478648.928078:0:19558:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789478648.928080:0:19558:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789478648.928081:0:19558:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789478648.928086:0:19558:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789478648.928088:0:19558:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789478648.928089:0:19558:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789478648.928090:0:19558:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789478648.928091:0:19558:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789478648.928092:0:19558:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789478648.928093:0:19558:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789478648.928094:0:19558:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789478648.928095:0:19558:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789478648.928096:0:19558:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789478648.928117:0:19558:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789478648.928134:0:19558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fedc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964526336:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789478648.928251:0:19558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478648.928298:0:19558:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc0302b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789478648.928762:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964526336 00000100:00100000:2.0:1789478648.928769:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964526336 00000100:00100000:2.0:1789478648.928886:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789478648.928896:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+24:19558:x1876403964526336:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789478648.928925:0:17232:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789478648.929367:0:17232:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789478648.932353:0:17232:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789478648.932376:0:17232:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789478648.932656:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+24:19558:x1876403964526336:12345-0@lo:253:mount.lustre.0 Request processed in 3757us (4399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478648.932669:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 20000000:01000000:1.0:1789478648.932814:0:17254:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789478648.932819:0:17254:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789478648.932839:0:17254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ebc08c4bc00/0x8ebaae74e8217202 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478648.932854:0:17254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc40f04400/0x8ebaae74e8217176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e821716f expref: 23 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478648.932862:0:17254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc40f04e00/0x8ebaae74e8217184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e821717d expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478648.932869:0:17254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ebc08c4bc00/0x8ebaae74e8217202 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478648.932914:0:17254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc40f04e00/0x8ebaae74e8217184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e821717d expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478648.932928:0:17254:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ebc40f04e00/0x8ebaae74e8217184 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e821717d expref: 23 pid: 17234 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478648.932941:0:17254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fff100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17254:1876403964526464:0@lo:104: 00000100:00100000:1.0:1789478648.932977:0:17254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789478648.933020:0:17254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc40f04400/0x8ebaae74e8217176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e821716f expref: 23 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478648.933028:0:17254:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ebc40f04400/0x8ebaae74e8217176 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e821716f expref: 23 pid: 17233 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478648.933036:0:17254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17254:1876403964526592:0@lo:104: 00000100:00100000:1.0:1789478648.933056:0:17254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478648.933071:0:17254:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08dadf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789478648.933089:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964526464 00000100:00100000:1.0:1789478648.933095:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964526464 00000100:00100000:1.0:1789478648.933125:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964526592 00000100:00100000:1.0:1789478648.933128:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964526592 00000100:00100000:0.0:1789478648.933265:0:19558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fedc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d53a32c3-7c45-4781-893e-f633d5432f2d:19558:1876403964526336:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789478648.933277:0:19558:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789478648.933280:0:19558:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789478648.933282:0:19558:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789478648.933283:0:19558:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789478648.933284:0:19558:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789478648.933286:0:19558:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789478648.933287:0:19558:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789478648.933289:0:19558:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789478648.933290:0:19558:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789478648.933292:0:19558:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789478648.933306:0:19558:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789478648.933901:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789478648.933913:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d53a32c3-7c45-4781-893e-f633d5432f2d+4:17254:x1876403964526464:12345-0@lo:104: 00010000:00010000:3.0:1789478648.933926:0:17223:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e821717d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8217184 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478648.934004:0:17223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789478648.934011:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d53a32c3-7c45-4781-893e-f633d5432f2d+4:17254:x1876403964526464:12345-0@lo:104: Request processed in 101us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478648.934018:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789478648.934035:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789478648.934042:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d53a32c3-7c45-4781-893e-f633d5432f2d+3:17254:x1876403964526592:12345-0@lo:104: 00010000:00010000:3.0:1789478648.934049:0:17223:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e821716f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8217176 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478648.934081:0:17223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789478648.934085:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d53a32c3-7c45-4781-893e-f633d5432f2d+3:17254:x1876403964526592:12345-0@lo:104: Request processed in 45us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478648.934090:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1789478648.934431:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789478648.934439:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e821717d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8217184 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.934457:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fc000 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:2.0:1789478648.934461:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e821717d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8217184 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.934470:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e821717d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8217184 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789478648.934477:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e821717d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8217184 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478648.934482:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789478648.934513:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e821717d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8217184 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.934520:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789478648.934539:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e821717d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8217184 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.934546:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc000/0x8ebaae74e821717d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8217184 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.934559:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478648.934562:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e821716f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8217176 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.934568:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fc400 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:2.0:1789478648.934571:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e821716f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8217176 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.934588:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e821716f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8217176 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789478648.934614:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e821716f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8217176 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789478648.934631:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789478648.934654:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e821716f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8217176 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.934661:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789478648.934667:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e821716f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8217176 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.934673:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc400/0x8ebaae74e821716f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8217176 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.934686:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478648.934688:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478648.934689:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478648.934704:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d53a32c3-7c45-4781-893e-f633d5432f2d:3645:1876403964526720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789478648.934755:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478648.934785:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789478648.934791:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc34cb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d53a32c3-7c45-4781-893e-f633d5432f2d:3645:1876403964526848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789478648.934811:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478648.934845:0:17991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964526720 00000100:00100000:2.0:1789478648.934850:0:17991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964526720 00010000:00010000:2.0:1789478648.934872:0:17991:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc40f04e00/0x8ebaae74e8217184 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e821717d expref: 24 pid: 17234 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478648.934908:0:17991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964526848 00000100:00100000:2.0:1789478648.934911:0:17991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964526848 00010000:00010000:2.0:1789478648.934923:0:17991:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc40f04400/0x8ebaae74e8217176 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e821716f expref: 25 pid: 17233 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478648.934939:0:17991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789478648.934946:0:17991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d53a32c3-7c45-4781-893e-f633d5432f2d+25:3645:x1876403964526720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789478648.934956:0:17991:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478648.934960:0:17991:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc40f04e00/0x8ebaae74e8217184 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e821717d expref: 25 pid: 17234 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.934971:0:17991:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc40f04e00/0x8ebaae74e8217184 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e821717d expref: 25 pid: 17234 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.934986:0:17991:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478648.935017:0:17991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d53a32c3-7c45-4781-893e-f633d5432f2d+25:3645:x1876403964526720:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478648.935023:0:17991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789478648.935038:0:17991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789478648.935044:0:17991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d53a32c3-7c45-4781-893e-f633d5432f2d+24:3645:x1876403964526848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789478648.935052:0:17991:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478648.935056:0:17991:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc40f04400/0x8ebaae74e8217176 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e821716f expref: 24 pid: 17233 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478648.936468:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478648.941826:0:17254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc40f04e00/0x8ebaae74e8217184 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e821717d expref: 24 pid: 17234 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478648.941847:0:17254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fff100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17254:1876403964526464:0@lo:104: 00000100:00100000:3.0:1789478648.941859:0:17254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17254:1876403964526592:0@lo:104: 00010000:00010000:2.0:1789478648.942750:0:17991:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc40f04400/0x8ebaae74e8217176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e821716f expref: 23 pid: 17233 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478648.946129:0:17254:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ebc08c4bc00/0x8ebaae74e8217202 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.947319:0:17991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc40f04400/0x8ebaae74e8217176 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e821716f expref: 23 pid: 17233 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.947345:0:17991:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ebc08c4bc00/0x8ebaae74e8217202 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.947353:0:17991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc08c4bc00/0x8ebaae74e8217202 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478648.947426:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d53a32c3-7c45-4781-893e-f633d5432f2d:3645:1876403964526720:0@lo:103:ldlm_bl.0 20000000:01000000:2.0:1789478648.947453:0:17991:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014634249s 00010000:00010000:2.0:1789478648.947459:0:17991:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc08c4bc00/0x8ebaae74e8217202 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.947466:0:17991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc08c4bc00/0x8ebaae74e8217202 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.947473:0:17991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ebc08c4bc00/0x8ebaae74e8217202 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.947479:0:17991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ebc08c4bc00/0x8ebaae74e8217202 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.947485:0:17991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4bc00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478648.947489:0:17991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ebc08c4bc00/0x8ebaae74e8217202 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.947497:0:17991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ebc08c4bc00/0x8ebaae74e8217202 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1789478648.953214:0:19558:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1789478648.955367:0:17254:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ebc08c4bc00/0x8ebaae74e8217202 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478648.955384:0:17254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ebc08c4bc00/0x8ebaae74e8217202 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.955465:0:17991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ebc08c4bc00/0x8ebaae74e8217202 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.955489:0:17991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc08c4bc00/0x8ebaae74e8217202 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478648.955513:0:17991:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478648.955813:0:17991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d53a32c3-7c45-4781-893e-f633d5432f2d+22:3645:x1876403964526848:12345-0@lo:103:ldlm_bl.0 Request processed in 20764us (20995us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478648.955823:0:17991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789478648.955906:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc34cb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d53a32c3-7c45-4781-893e-f633d5432f2d:3645:1876403964526848:0@lo:103:ldlm_bl.0 00002000:00080000:0.0:1789478648.956220:0:19558:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789478648.956225:0:19558:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789478648.956255:0:19558:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789478648.956287:0:19558:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789478648.956302:0:19558:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1789478648.956316:0:19558:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1789478648.961590:0:19558:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789478648.962157:0:19558:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789478649.061553:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789478649.513451:0:17274:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1789478649.879058:0:19624:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789478649.879310:0:19624:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789478650.089730:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478650.597908:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964526976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789478650.597970:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478650.598061:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964526976 00000100:00100000:3.0:1789478650.598068:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964526976 00000100:00100000:3.0:1789478650.598123:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789478650.598132:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964526976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789478650.598168:0:18750:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789478650.598212:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964526976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478650.598220:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789478650.598268:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789478650.598298:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03598380 x1876403964526976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478666 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478650.598318:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964526976:0@lo:13:osp-pre-0-1.0 10000000:01000000:2.0:1789478650.853532:0:17236:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789478650.853540:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ebc35b1c000 from 10 10000000:01000000:2.0:1789478650.853545:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789478650.853634:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76200/0x8ebaae74e8217209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478650.853647:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76200/0x8ebaae74e8217209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478650.853658:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76200/0x8ebaae74e8217209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478650.853683:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964527104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789478650.853748:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478650.853790:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc04fca780 going to sleep for 11 seconds 00000100:00100000:3.0:1789478650.854428:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964527104 00000100:00100000:3.0:1789478650.854436:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964527104 00000100:00100000:3.0:1789478650.854666:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789478650.854676:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+22:17236:x1876403964527104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789478650.854691:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478650.854707:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebb035fd000/0x8ebaae74e8217210 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8217209 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478650.854730:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebb035fd000/0x8ebaae74e8217210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8217209 expref: 23 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478650.854741:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebb035fd000/0x8ebaae74e8217210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8217209 expref: 23 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478650.854750:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fd000, rc 0) 00000100:00100000:3.0:1789478650.854905:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+23:17236:x1876403964527104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478650.854912:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789478650.855589:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964527104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789478650.855639:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76200/0x8ebaae74e8217209 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217210 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478650.855648:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76200/0x8ebaae74e8217209 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8217210 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478650.855721:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964527232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789478650.855770:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478650.855809:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08dad540 going to sleep for 11 seconds 00000100:00100000:2.0:1789478650.855867:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964527232 00000100:00100000:2.0:1789478650.855873:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964527232 00000100:00100000:2.0:1789478650.855918:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789478650.855934:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+23:17236:x1876403964527232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789478650.855953:0:17232:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789478650.855972:0:17232:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789478650.855975:0:17232:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1789478650.856061:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+23:17236:x1876403964527232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478650.856067:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789478650.856201:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964527232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789478650.856268:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789478650.856276:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76200/0x8ebaae74e8217209 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217210 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478650.856284:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc34f76200/0x8ebaae74e8217209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217210 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478650.856293:0:17236:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789478650.856295:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ebb0372d800 from 10 10000000:01000000:1.0:1789478650.856298:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789478650.856319:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4a800/0x8ebaae74e8217217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478650.856325:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4a800/0x8ebaae74e8217217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478650.856333:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4a800/0x8ebaae74e8217217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478650.856367:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964527360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789478650.856392:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478650.856414:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08dad540 going to sleep for 11 seconds 00000100:00100000:3.0:1789478650.856907:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964527360 00000100:00100000:3.0:1789478650.856913:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964527360 00000100:00100000:3.0:1789478650.856952:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789478650.856960:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+23:17236:x1876403964527360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789478650.856969:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478650.856981:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebb035fcc00/0x8ebaae74e821721e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8217217 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478650.857009:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebb035fcc00/0x8ebaae74e821721e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8217217 expref: 24 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478650.857017:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebb035fcc00/0x8ebaae74e821721e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8217217 expref: 24 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478650.857025:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebb035fcc00, rc 0) 00000100:00100000:3.0:1789478650.857072:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+24:17236:x1876403964527360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478650.857078:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789478650.857200:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964527360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789478650.857213:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4a800/0x8ebaae74e8217217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e821721e expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478650.857221:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4a800/0x8ebaae74e8217217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e821721e expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478650.857267:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964527488:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789478650.857297:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478650.857329:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08dad540 going to sleep for 11 seconds 00000100:00100000:0.0:1789478650.857435:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964527488 00000100:00100000:0.0:1789478650.857440:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964527488 00000100:00100000:0.0:1789478650.857471:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789478650.857478:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+24:17236:x1876403964527488:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789478650.857489:0:17234:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789478650.857503:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789478650.857506:0:17234:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1789478650.857580:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+24:17236:x1876403964527488:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478650.857586:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789478650.859533:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964527488:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789478650.859645:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789478650.859655:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4a800/0x8ebaae74e8217217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e821721e expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478650.859664:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4a800/0x8ebaae74e8217217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e821721e expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478651.108810:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789478651.108832:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964527616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478651.108896:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478651.109039:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964527616 00000100:00100000:3.0:1789478651.109046:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964527616 00000100:00100000:3.0:1789478651.109104:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789478651.109114:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964527616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789478651.109148:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789478651.109195:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964527616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478651.109202:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1789478651.109702:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478651.109747:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964527616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478651.623309:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964527744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789478651.623386:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478651.623441:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964527744 00000100:00100000:1.0:1789478651.623450:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964527744 00000100:00100000:1.0:1789478651.623496:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789478651.623506:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964527744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789478651.623541:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789478651.623587:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964527744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478651.623632:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789478651.623679:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964527744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789478652.006747:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789478632/real 1789478632] req@ffff8ebb03feed80 x1876403964514432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789478652 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478652.006778:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ebb03feed80 x1876403964514432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789478652 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478652.006790:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789478632/real 1789478632] req@ffff8ebb03fef100 x1876403964514560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789478652 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478652.006800:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ebb03fef100 x1876403964514560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789478652 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789478652.006836:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc3bcd8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789478652.006858:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789478652.006862:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03feed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964514432:0@lo:8:kworker.0 00000100:00080000:3.0:1789478652.006868:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc06fa9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789478652.006873:0:3644:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789478652.006876:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964514560:0@lo:8:kworker.0 00000100:00080000:2.0:1789478652.007008:0:14273:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789478652.007012:0:14273:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789478652.007015:0:14273:0:(import.c:65:import_set_state_nolock()) ffff8ebc3bcd8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789478652.007019:0:14273:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 461 00000100:00080000:2.0:1789478652.007024:0:14273:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789478652.007033:0:14273:0:(import.c:625:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ebc3bcd8800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1789478652.007052:0:14273:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebc40f62d80 x1876403964528128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789478652.007063:0:14273:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789478652.007066:0:14273:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789478652.007067:0:14273:0:(import.c:65:import_set_state_nolock()) ffff8ebc06fa9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789478652.007070:0:14273:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 461 00000100:00080000:2.0:1789478652.007072:0:14273:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789478652.007075:0:14273:0:(import.c:625:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ebc06fa9800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1789478652.007086:0:14273:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebc40f60000 x1876403964528256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789478652.007110:0:14273:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789478652.007113:0:14273:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789478652.007120:0:14273:0:(import.c:65:import_set_state_nolock()) ffff8ebc1897e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789478652.007139:0:14273:0:(import.c:625:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ebc1897e000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1789478652.007152:0:14273:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ebc40f62680 x1876403964528768/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789478652.007211:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964528512:0@lo:400:kworker.0 00000100:00100000:2.0:1789478652.007287:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478652.007327:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964529152:0@lo:400:kworker.0 00000100:00100000:2.0:1789478652.007351:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478652.007370:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789478652.007376:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d53a32c3-7c45-4781-893e-f633d5432f2d:3645:1876403964527872:0@lo:400:kworker.0 00000100:00100000:2.0:1789478652.007401:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478652.007423:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964528640:0@lo:400:kworker.0 00000100:00100000:2.0:1789478652.007444:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478652.007463:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964529280:0@lo:400:kworker.0 00000100:00100000:2.0:1789478652.007484:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478652.007508:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964528000:0@lo:400:kworker.0 00000100:00100000:2.0:1789478652.007539:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478652.007556:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964528896:0@lo:400:kworker.0 00000100:00100000:2.0:1789478652.007575:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478652.007587:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964529408:0@lo:400:kworker.0 00000100:00100000:2.0:1789478652.007647:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478652.007664:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789478652.007669:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964528384:0@lo:400:kworker.0 00000100:00100000:2.0:1789478652.007687:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478652.007706:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964529024:0@lo:400:kworker.0 00000100:00100000:2.0:1789478652.007724:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478652.007747:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964528512 00000100:00100000:2.0:1789478652.007753:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964528512 00000100:00100000:2.0:1789478652.007784:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964528000 00000100:00100000:2.0:1789478652.007787:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964528000 00000100:00100000:2.0:1789478652.007801:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789478652.007809:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964528512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478652.007870:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964528512:12345-0@lo:400:kworker.0 Request processed in 62us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478652.007877:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789478652.007892:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789478652.007897:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964528000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478652.007922:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964528000:12345-0@lo:400:kworker.0 Request processed in 25us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478652.007927:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789478652.007944:0:18465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964529152 00000100:00100000:2.0:1789478652.007947:0:18465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964529152 00000100:00100000:2.0:1789478652.007971:0:18465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964529280 00000100:00100000:2.0:1789478652.007974:0:18465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964529280 00000100:00100000:2.0:1789478652.007985:0:18465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964528896 00000100:00100000:2.0:1789478652.007988:0:18465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964528896 00000100:00100000:2.0:1789478652.007997:0:18465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964529408 00000100:00100000:2.0:1789478652.007999:0:18465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964529408 00000100:00100000:2.0:1789478652.008008:0:18465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964528384 00000100:00100000:2.0:1789478652.008010:0:18465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964528384 00000100:00100000:2.0:1789478652.008019:0:18465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964529024 00000100:00100000:2.0:1789478652.008021:0:18465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964529024 00000100:00100000:2.0:1789478652.008033:0:18465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789478652.008039:0:18465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964529152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478652.008072:0:18465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964529152:12345-0@lo:400:kworker.0 Request processed in 34us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478652.008078:0:18465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789478652.008090:0:18465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789478652.008096:0:18465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964529280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478652.008118:0:18465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964529280:12345-0@lo:400:kworker.0 Request processed in 23us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478652.008123:0:18465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789478652.008133:0:18465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789478652.008138:0:18465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964528896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478652.008159:0:18465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964528896:12345-0@lo:400:kworker.0 Request processed in 22us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478652.008165:0:18465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789478652.008175:0:18465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789478652.008181:0:18465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964529408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478652.008204:0:18465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964529408:12345-0@lo:400:kworker.0 Request processed in 24us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478652.008210:0:18465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789478652.008219:0:18465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789478652.008225:0:18465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964528384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478652.008249:0:18465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964528384:12345-0@lo:400:kworker.0 Request processed in 24us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478652.008254:0:18465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789478652.008265:0:18465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789478652.008271:0:18465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964529024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478652.008304:0:18465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964529024:12345-0@lo:400:kworker.0 Request processed in 34us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478652.008310:0:18465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789478652.008328:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964527872 00000100:00100000:2.0:1789478652.008331:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964527872 00000100:00100000:2.0:1789478652.008358:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789478652.008364:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+24:3645:x1876403964527872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478652.008391:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+24:3645:x1876403964527872:12345-0@lo:400:kworker.0 Request processed in 27us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478652.008397:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789478652.008420:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964528640 00000100:00100000:2.0:1789478652.008424:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964528640 00000100:00100000:2.0:1789478652.008448:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789478652.008453:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40f60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964528640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478652.008479:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40f60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964528640:12345-0@lo:400:kworker.0 Request processed in 26us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478652.008485:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789478652.008511:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789478652.008515:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789478652.008517:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789478652.008545:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f60a80 x1876403964528384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478652.008557:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964528384:0@lo:400:kworker.0 00010000:00080000:2.0:1789478652.008567:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f61500 x1876403964529024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478652.008575:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964529024:0@lo:400:kworker.0 00000100:00100000:2.0:1789478652.008629:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964528000:0@lo:400:kworker.0 00010000:00080000:2.0:1789478652.008643:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f63b80 x1876403964528896/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478652.008650:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964528896:0@lo:400:kworker.0 00010000:00080000:2.0:1789478652.008662:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f62300 x1876403964529408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478652.008669:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964529408:0@lo:400:kworker.0 00000100:00100000:2.0:1789478652.008704:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d53a32c3-7c45-4781-893e-f633d5432f2d:3645:1876403964527872:0@lo:400:kworker.0 00010000:00080000:2.0:1789478652.008714:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f61880 x1876403964528640/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789478668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478652.008721:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964528640:0@lo:400:kworker.0 00010000:00080000:2.0:1789478652.008731:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f63800 x1876403964529280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478652.008738:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964529280:0@lo:400:kworker.0 00000100:00100000:2.0:1789478652.008747:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964528512:0@lo:400:kworker.0 00010000:00080000:2.0:1789478652.008755:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f60700 x1876403964529152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478652.008763:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964529152:0@lo:400:kworker.0 00000100:00100000:3.0:1789478652.009228:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964528128:0@lo:8:kworker.0 00000100:00100000:3.0:1789478652.009277:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478652.009322:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964528256:0@lo:8:kworker.0 00000100:00100000:3.0:1789478652.009348:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478652.009365:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40f62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964528768:0@lo:8:kworker.0 00000100:00100000:3.0:1789478652.009401:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478652.009431:0:19341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964528128 00000100:00100000:3.0:1789478652.009436:0:19341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964528128 00000100:00100000:3.0:1789478652.009456:0:19341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964528256 00000100:00100000:3.0:1789478652.009458:0:19341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964528256 00000100:00100000:3.0:1789478652.009465:0:19341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964528768 00000100:00100000:3.0:1789478652.009467:0:19341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964528768 00000100:00100000:3.0:1789478652.009477:0:19341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789478652.009483:0:19341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1876403964528128:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789478652.009510:0:19341:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 481 last 0 00000020:00000080:3.0:1789478652.009761:0:19341:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8ebaae74e8217225 00002000:00100000:3.0:1789478652.009777:0:19341:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ebb02058800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789478652.009781:0:19341:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789478652.009790:0:19341:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789478652.009864:0:19341:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789478652.009887:0:19341:0:(import.c:65:import_set_state_nolock()) ffff8ebb0205e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789478652.009934:0:19341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1876403964528128:12345-0@lo:8:kworker.0 Request processed in 450us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478652.009941:0:19341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789478652.009958:0:19341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789478652.009962:0:19341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb0359b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1876403964528256:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789478652.009978:0:19341:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 481 last 0 00000020:00000080:3.0:1789478652.009994:0:19341:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8ebaae74e821722c 00002000:00100000:3.0:1789478652.010000:0:19341:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8ebb02059000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789478652.010004:0:19341:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789478652.010006:0:19341:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789478652.010125:0:19341:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789478652.010153:0:19341:0:(import.c:65:import_set_state_nolock()) ffff8ebb02059800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789478652.010184:0:19341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb0359b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1876403964528256:12345-0@lo:8:kworker.0 Request processed in 220us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478652.010191:0:19341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789478652.010204:0:19341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789478652.010208:0:19341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1876403964528768:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789478652.010456:0:19341:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 481 last 0 00000020:00000080:3.0:1789478652.010471:0:19341:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8ebaae74e8217233 00002000:00100000:3.0:1789478652.010478:0:19341:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8ebb0205d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789478652.010481:0:19341:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1789478652.010483:0:19341:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789478652.010504:0:19341:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1789478652.010521:0:19341:0:(import.c:65:import_set_state_nolock()) ffff8ebb0205b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789478652.010557:0:19341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3644:x1876403964528768:12345-0@lo:8:kworker.0 Request processed in 347us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478652.010563:0:19341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789478652.010642:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f62d80 x1876403964528128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789478677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478652.010653:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789478652.010660:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789478652.010666:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789478652.010671:0:3644:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789478652.010673:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc3bcd8800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789478652.010693:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789478652.010697:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964528128:0@lo:8:kworker.0 00010000:00080000:3.0:1789478652.010708:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f60000 x1876403964528256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789478677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478652.010715:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789478652.010718:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789478652.010722:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789478652.010725:0:3644:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789478652.010727:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc06fa9800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789478652.010735:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789478652.010737:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876403964528256:0@lo:8:kworker.0 00010000:00080000:3.0:1789478652.010746:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc40f62680 x1876403964528768/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789478677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789478652.010753:0:3644:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789478652.010758:0:3644:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789478652.010765:0:3644:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789478652.010767:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ebc1897e000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789478652.010781:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789478652.010784:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40f62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876403964528768:0@lo:8:kworker.0 00000004:00080000:3.0:1789478652.010832:0:17263:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:3.0:1789478652.010848:0:17263:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17263:1876403964529664:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789478652.010873:0:17263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478652.010888:0:17263:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc21b34840 going to sleep for 11 seconds 00000004:00080000:3.0:1789478652.010899:0:17981:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789478652.010951:0:17981:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 481126356560ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789478652.010957:0:17981:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789478652.014455:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964529664 00000100:00100000:2.0:1789478652.014467:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964529664 00000100:00100000:2.0:1789478652.014539:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789478652.014560:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17263:x1876403964529664:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789478652.014794:0:17264:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789478652.014857:0:17264:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 481130262586ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789478652.014863:0:17264:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:2.0:1789478652.014955:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789478652.014993:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789478652.015008:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964529536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789478652.015072:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478652.015113:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964529536 00000100:00100000:2.0:1789478652.015117:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964529536 00000100:00100000:2.0:1789478652.015144:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789478652.015150:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1876403964529536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789478652.015167:0:18750:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789478652.015203:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1876403964529536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478652.015210:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789478652.015255:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03598380 x1876403964529536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478652.015283:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964529536:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1789478652.015883:0:17982:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789478652.015902:0:17982:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f3a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17982:1876403964529920:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1789478652.015936:0:17982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478652.015954:0:17982:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34f72780 going to sleep for 11 seconds 00000100:00100000:3.0:1789478652.015967:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789478652.015975:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964529792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789478652.015996:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478652.016017:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964529920 00000100:00100000:3.0:1789478652.016021:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964529920 00000100:00100000:3.0:1789478652.016049:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789478652.016056:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17982:x1876403964529920:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:2.0:1789478652.016915:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789478652.017015:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964529792 00000100:00100000:2.0:1789478652.017021:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964529792 00000100:00100000:2.0:1789478652.017053:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789478652.017061:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3646:x1876403964529792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789478652.017082:0:18750:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789478652.017147:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3646:x1876403964529792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478652.017162:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789478652.017202:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03f3b800 x1876403964529792/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478652.017718:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964529792:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1789478652.017918:0:17262:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789478652.017994:0:17262:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 481133399996ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789478652.018001:0:17262:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789478652.018053:0:17265:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1789478652.018083:0:17265:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03feed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17265:1876403964530176:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789478652.019999:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964530048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789478652.020069:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478652.020692:0:17265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478652.020720:0:17265:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc3c8a6a80 going to sleep for 11 seconds 00000004:00080000:0.0:1789478652.020777:0:17971:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1789478652.020822:0:19341:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1789478652.020831:0:19341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1789478652.020927:0:19341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964530176 00000100:00100000:0.0:1789478652.020935:0:19341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964530176 00000100:00100000:0.0:1789478652.021042:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789478652.021051:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17265:x1876403964530176:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789478652.024440:0:17219:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00080000:2.0:1789478652.025451:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789478652.025483:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964530048 00000100:00100000:2.0:1789478652.025493:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964530048 00000100:00100000:2.0:1789478652.025995:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789478652.026009:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876403964530048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789478652.026033:0:18750:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789478652.026110:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876403964530048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (6042us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478652.026117:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789478652.026177:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03fef100 x1876403964530048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789478668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478652.026198:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964530048:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1789478652.035307:0:17219:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:3.0:1789478652.042683:0:18746:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789478652.042693:0:18746:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789478652.042777:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17982:x1876403964529920:12345-0@lo:7:osp-pre-1-1.0 Request processed in 26717us (26835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478652.042788:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789478652.042844:0:17982:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03f3a300 x1876403964529920/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789478668 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478652.042859:0:17982:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f3a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17982:1876403964529920:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1789478652.042870:0:17982:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789478652.042903:0:17982:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f3a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17982:1876403964530304:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789478652.042931:0:17982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478652.042953:0:17982:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34f72780 going to sleep for 11 seconds 00000100:00100000:3.0:1789478652.042968:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964530304 00000100:00100000:3.0:1789478652.042973:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964530304 00000100:00100000:3.0:1789478652.043004:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789478652.043012:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17982:x1876403964530304:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789478652.043033:0:18746:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1789478652.043060:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17982:x1876403964530304:12345-0@lo:5:osp-pre-1-1.0 Request processed in 49us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478652.043066:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789478652.043086:0:17982:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03f3a300 x1876403964530304/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789478668 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478652.043096:0:17982:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f3a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17982:1876403964530304:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789478652.043103:0:17982:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789478652.043136:0:17982:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f3a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17982:1876403964530432:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789478652.043157:0:17982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478652.043176:0:17982:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc34f72780 going to sleep for 11 seconds 00000100:00100000:3.0:1789478652.043186:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964530432 00000100:00100000:3.0:1789478652.043189:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964530432 00000100:00100000:3.0:1789478652.043204:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789478652.043209:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17982:x1876403964530432:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789478652.043236:0:18746:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:2.0:1789478652.046426:0:19739:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1789478652.046437:0:19739:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789478652.046442:0:19739:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00080000:0.0:1789478652.052856:0:18747:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1789478652.052869:0:18747:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1789478652.052876:0:18747:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00010000:2.0:1789478652.072814:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789478652.072827:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074fcd2f0/0x8ebaae74e821723a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.072850:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789478652.072854:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478652.072860:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074fcd2f0/0x8ebaae74e821723a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.072878:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074fcd2f0/0x8ebaae74e821723a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.072888:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074fcd2f0/0x8ebaae74e821723a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.072897:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074fcd2f0/0x8ebaae74e821723a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.072913:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789478652.072925:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478652.072930:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074fcd2f0/0x8ebaae74e821723a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.072937:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76e00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478652.072942:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074fcd2f0/0x8ebaae74e821723a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.072952:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074fcd2f0/0x8ebaae74e821723a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.072980:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074fcd2f0/0x8ebaae74e821723a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.072988:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074fcd2f0/0x8ebaae74e821723a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.073004:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.073006:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.073009:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789478652.077488:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789478652.077502:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3ff7fce/0x8ebaae74e8217241 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.077516:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=481s v=(0 0) 00010000:00010000:1.0:1789478652.077521:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478652.077527:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3ff7fce/0x8ebaae74e8217241 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.077543:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3ff7fce/0x8ebaae74e8217241 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.077553:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3ff7fce/0x8ebaae74e8217241 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.077571:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3ff7fce/0x8ebaae74e8217241 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.077587:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789478652.078221:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478652.078229:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3ff7fce/0x8ebaae74e8217241 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.078239:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4b400 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478652.078243:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3ff7fce/0x8ebaae74e8217241 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.078252:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3ff7fce/0x8ebaae74e8217241 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789478652.079456:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789478652.079467:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aad2c96/0x8ebaae74e8217248 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.079479:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=481s v=(0 0) 00010000:00010000:1.0:1789478652.079483:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478652.079487:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aad2c96/0x8ebaae74e8217248 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.079499:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003aad2c96/0x8ebaae74e8217248 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.079508:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aad2c96/0x8ebaae74e8217248 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.079515:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003aad2c96/0x8ebaae74e8217248 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.079537:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789478652.081186:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3ff7fce/0x8ebaae74e8217241 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.081206:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3ff7fce/0x8ebaae74e8217241 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.081252:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478652.081256:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003aad2c96/0x8ebaae74e8217248 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.081263:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4ba00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478652.081267:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003aad2c96/0x8ebaae74e8217248 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.081275:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003aad2c96/0x8ebaae74e8217248 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.081292:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003aad2c96/0x8ebaae74e8217248 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.081437:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003aad2c96/0x8ebaae74e8217248 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.081452:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.081454:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.081457:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789478652.081947:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789478652.081955:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a4eb253/0x8ebaae74e821724f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.081974:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=481s v=(0 0) 00010000:00010000:1.0:1789478652.081978:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478652.081985:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a4eb253/0x8ebaae74e821724f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.081997:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a4eb253/0x8ebaae74e821724f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.082006:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a4eb253/0x8ebaae74e821724f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.082014:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a4eb253/0x8ebaae74e821724f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.082038:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789478652.082222:0:18393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789478652.082229:0:18393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a4eb253/0x8ebaae74e821724f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.082237:0:18393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4b600 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478652.082241:0:18393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a4eb253/0x8ebaae74e821724f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.082250:0:18393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a4eb253/0x8ebaae74e821724f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.082278:0:18393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a4eb253/0x8ebaae74e821724f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.082286:0:18393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a4eb253/0x8ebaae74e821724f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.083489:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.083493:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.083496:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.083554:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789478652.084020:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789478652.084030:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006317bbaf/0x8ebaae74e8217256 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.084045:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=481s v=(0 0) 00010000:00010000:1.0:1789478652.084048:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478652.084054:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006317bbaf/0x8ebaae74e8217256 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.084067:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006317bbaf/0x8ebaae74e8217256 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.084092:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006317bbaf/0x8ebaae74e8217256 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.084099:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006317bbaf/0x8ebaae74e8217256 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.084117:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789478652.085494:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478652.085504:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006317bbaf/0x8ebaae74e8217256 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.085515:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4b800 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478652.085530:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006317bbaf/0x8ebaae74e8217256 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.085541:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006317bbaf/0x8ebaae74e8217256 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.085560:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006317bbaf/0x8ebaae74e8217256 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.085567:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006317bbaf/0x8ebaae74e8217256 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.085588:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.085590:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.085609:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789478652.086516:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789478652.086526:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d77e7033/0x8ebaae74e821725d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.086540:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=481s v=(0 0) 00010000:00010000:1.0:1789478652.086545:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478652.086551:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d77e7033/0x8ebaae74e821725d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.086562:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d77e7033/0x8ebaae74e821725d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.086571:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d77e7033/0x8ebaae74e821725d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.086579:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d77e7033/0x8ebaae74e821725d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.086647:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789478652.087503:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789478652.087510:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d96df3c7/0x8ebaae74e8217264 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.087520:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=481s v=(0 0) 00010000:00010000:1.0:1789478652.087524:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478652.087528:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d96df3c7/0x8ebaae74e8217264 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.087539:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d96df3c7/0x8ebaae74e8217264 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.087547:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d96df3c7/0x8ebaae74e8217264 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.087553:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d96df3c7/0x8ebaae74e8217264 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.087573:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789478652.087837:0:18393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789478652.087844:0:18393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d77e7033/0x8ebaae74e821725d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.087852:0:18393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4be00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478652.087857:0:18393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d77e7033/0x8ebaae74e821725d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.087866:0:18393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d77e7033/0x8ebaae74e821725d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.087880:0:18393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d77e7033/0x8ebaae74e821725d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.087894:0:18393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d77e7033/0x8ebaae74e821725d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.087911:0:18393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478652.087914:0:18393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d96df3c7/0x8ebaae74e8217264 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.087920:0:18393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4bc00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478652.087923:0:18393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d96df3c7/0x8ebaae74e8217264 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.087930:0:18393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d96df3c7/0x8ebaae74e8217264 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.087939:0:18393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d96df3c7/0x8ebaae74e8217264 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.087945:0:18393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d96df3c7/0x8ebaae74e8217264 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.087954:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.087955:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.087957:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.088020:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789478652.091768:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789478652.091783:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9211d06/0x8ebaae74e821726b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.091798:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=481s v=(0 0) 00010000:00010000:1.0:1789478652.091814:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478652.091820:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9211d06/0x8ebaae74e821726b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.091832:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9211d06/0x8ebaae74e821726b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.091842:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9211d06/0x8ebaae74e821726b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.091849:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9211d06/0x8ebaae74e821726b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.091875:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789478652.093021:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478652.093030:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9211d06/0x8ebaae74e821726b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.093047:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4a200 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478652.093052:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9211d06/0x8ebaae74e821726b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.093062:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9211d06/0x8ebaae74e821726b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.093080:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9211d06/0x8ebaae74e821726b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.093159:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9211d06/0x8ebaae74e821726b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.093177:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.093179:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.093181:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789478652.098480:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789478652.098492:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3e5c5fd/0x8ebaae74e8217272 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.098509:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=481s v=(0 0) 00010000:00010000:1.0:1789478652.098513:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478652.098519:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3e5c5fd/0x8ebaae74e8217272 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.098532:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3e5c5fd/0x8ebaae74e8217272 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.098542:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3e5c5fd/0x8ebaae74e8217272 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.098556:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3e5c5fd/0x8ebaae74e8217272 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.098580:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789478652.098782:0:18393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478652.098790:0:18393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3e5c5fd/0x8ebaae74e8217272 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.098799:0:18393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4b200 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478652.098803:0:18393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3e5c5fd/0x8ebaae74e8217272 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.098812:0:18393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3e5c5fd/0x8ebaae74e8217272 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.098836:0:18393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3e5c5fd/0x8ebaae74e8217272 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.098843:0:18393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3e5c5fd/0x8ebaae74e8217272 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.098862:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.098863:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.098865:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789478652.099336:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789478652.099343:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a442e12/0x8ebaae74e8217279 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.099353:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=481s v=(0 0) 00010000:00010000:1.0:1789478652.099356:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478652.099361:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a442e12/0x8ebaae74e8217279 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.099371:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a442e12/0x8ebaae74e8217279 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.099379:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a442e12/0x8ebaae74e8217279 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.099387:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a442e12/0x8ebaae74e8217279 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.099412:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789478652.099572:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478652.099578:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a442e12/0x8ebaae74e8217279 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.099586:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4aa00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478652.099589:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a442e12/0x8ebaae74e8217279 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.099633:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a442e12/0x8ebaae74e8217279 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.099646:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a442e12/0x8ebaae74e8217279 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.099652:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a442e12/0x8ebaae74e8217279 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.099678:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.099680:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.099682:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789478652.100614:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789478652.100633:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bdbe2be/0x8ebaae74e8217280 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.100651:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=481s v=(0 0) 00010000:00010000:1.0:1789478652.100655:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478652.100660:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bdbe2be/0x8ebaae74e8217280 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.100672:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bdbe2be/0x8ebaae74e8217280 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.100679:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bdbe2be/0x8ebaae74e8217280 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.100686:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bdbe2be/0x8ebaae74e8217280 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.100703:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789478652.101052:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478652.101059:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bdbe2be/0x8ebaae74e8217280 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.101068:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fce000 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478652.101073:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bdbe2be/0x8ebaae74e8217280 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.101082:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bdbe2be/0x8ebaae74e8217280 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.101096:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bdbe2be/0x8ebaae74e8217280 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.101105:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bdbe2be/0x8ebaae74e8217280 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.101120:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.101131:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.101133:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789478652.101541:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789478652.101548:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd654ab4/0x8ebaae74e8217287 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.101556:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=481s v=(0 0) 00010000:00010000:1.0:1789478652.101560:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478652.101564:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd654ab4/0x8ebaae74e8217287 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.101574:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd654ab4/0x8ebaae74e8217287 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.101616:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd654ab4/0x8ebaae74e8217287 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.101633:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd654ab4/0x8ebaae74e8217287 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.101650:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789478652.102028:0:18393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478652.102034:0:18393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd654ab4/0x8ebaae74e8217287 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.102053:0:18393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcf800 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478652.102058:0:18393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd654ab4/0x8ebaae74e8217287 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.102066:0:18393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd654ab4/0x8ebaae74e8217287 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.102077:0:18393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd654ab4/0x8ebaae74e8217287 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.102084:0:18393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd654ab4/0x8ebaae74e8217287 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.102099:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.102101:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.102102:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789478652.102374:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789478652.102380:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa398b24/0x8ebaae74e821728e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.102388:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=481s v=(0 0) 00010000:00010000:1.0:1789478652.102391:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478652.102396:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa398b24/0x8ebaae74e821728e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.102406:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa398b24/0x8ebaae74e821728e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.102415:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa398b24/0x8ebaae74e821728e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.102422:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa398b24/0x8ebaae74e821728e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.102458:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789478652.103029:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478652.103036:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa398b24/0x8ebaae74e821728e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.103045:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfa00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478652.103049:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa398b24/0x8ebaae74e821728e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.103057:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa398b24/0x8ebaae74e821728e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.103080:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa398b24/0x8ebaae74e821728e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.103088:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa398b24/0x8ebaae74e821728e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.103106:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.103107:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.103109:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789478652.104779:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789478652.104790:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f3c6850/0x8ebaae74e8217295 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.104804:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=481s v=(0 0) 00010000:00010000:1.0:1789478652.104808:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478652.104814:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f3c6850/0x8ebaae74e8217295 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.104826:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f3c6850/0x8ebaae74e8217295 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.104834:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f3c6850/0x8ebaae74e8217295 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.104841:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f3c6850/0x8ebaae74e8217295 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.104859:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789478652.105152:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478652.105160:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f3c6850/0x8ebaae74e8217295 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.105167:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcf000 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478652.105172:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f3c6850/0x8ebaae74e8217295 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.105180:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f3c6850/0x8ebaae74e8217295 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.105194:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f3c6850/0x8ebaae74e8217295 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.105202:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f3c6850/0x8ebaae74e8217295 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.105231:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.105233:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.105235:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789478652.106412:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789478652.106421:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0ee3a08/0x8ebaae74e821729c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.106434:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=481s v=(0 0) 00010000:00010000:1.0:1789478652.106443:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478652.106449:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0ee3a08/0x8ebaae74e821729c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.106461:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0ee3a08/0x8ebaae74e821729c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.106470:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0ee3a08/0x8ebaae74e821729c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.106746:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0ee3a08/0x8ebaae74e821729c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.106767:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789478652.106791:0:18393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478652.106797:0:18393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0ee3a08/0x8ebaae74e821729c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.106805:0:18393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcec00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478652.106809:0:18393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0ee3a08/0x8ebaae74e821729c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.106817:0:18393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0ee3a08/0x8ebaae74e821729c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.106829:0:18393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0ee3a08/0x8ebaae74e821729c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.106837:0:18393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0ee3a08/0x8ebaae74e821729c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.106852:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.106854:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.106856:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789478652.107386:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789478652.107394:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000453e1fdc/0x8ebaae74e82172a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.107405:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=481s v=(0 0) 00010000:00010000:1.0:1789478652.107408:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478652.107412:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000453e1fdc/0x8ebaae74e82172a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.107420:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000453e1fdc/0x8ebaae74e82172a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.107427:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000453e1fdc/0x8ebaae74e82172a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.107440:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000453e1fdc/0x8ebaae74e82172a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.107454:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789478652.107785:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478652.107792:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000453e1fdc/0x8ebaae74e82172a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.107809:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcee00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478652.107813:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000453e1fdc/0x8ebaae74e82172a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.107821:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000453e1fdc/0x8ebaae74e82172a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.107831:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000453e1fdc/0x8ebaae74e82172a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.107838:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000453e1fdc/0x8ebaae74e82172a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.107853:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.107854:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.107856:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789478652.108531:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789478652.108539:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c26c3415/0x8ebaae74e82172aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.108549:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=481s v=(0 0) 00010000:00010000:1.0:1789478652.108552:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478652.108556:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c26c3415/0x8ebaae74e82172aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.108565:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c26c3415/0x8ebaae74e82172aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.108572:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c26c3415/0x8ebaae74e82172aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.108578:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c26c3415/0x8ebaae74e82172aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.108628:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789478652.108924:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789478652.108931:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000742eeba/0x8ebaae74e82172b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.108946:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=481s v=(0 0) 00010000:00010000:1.0:1789478652.108949:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478652.108953:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000742eeba/0x8ebaae74e82172b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.108962:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000742eeba/0x8ebaae74e82172b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.108970:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000742eeba/0x8ebaae74e82172b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.108977:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000742eeba/0x8ebaae74e82172b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.108992:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789478652.109350:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789478652.109357:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c26c3415/0x8ebaae74e82172aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.109365:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fce200 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:0.0:1789478652.109370:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c26c3415/0x8ebaae74e82172aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.109379:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c26c3415/0x8ebaae74e82172aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.109394:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c26c3415/0x8ebaae74e82172aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.109402:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c26c3415/0x8ebaae74e82172aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.109424:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789478652.109428:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000742eeba/0x8ebaae74e82172b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.109434:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fce400 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:0.0:1789478652.109437:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000742eeba/0x8ebaae74e82172b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.109445:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000742eeba/0x8ebaae74e82172b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.109455:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000742eeba/0x8ebaae74e82172b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.109462:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000742eeba/0x8ebaae74e82172b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.109472:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478652.109474:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478652.109476:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789478652.109523:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789478652.109529:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b6a7d9d/0x8ebaae74e82172b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.109537:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=481s v=(0 0) 00010000:00010000:0.0:1789478652.109546:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478652.109550:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b6a7d9d/0x8ebaae74e82172b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.109562:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b6a7d9d/0x8ebaae74e82172b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.109570:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b6a7d9d/0x8ebaae74e82172b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.109577:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b6a7d9d/0x8ebaae74e82172b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.109630:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789478652.109734:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789478652.109740:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b6a7d9d/0x8ebaae74e82172b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.109748:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40f04000 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478652.109757:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b6a7d9d/0x8ebaae74e82172b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.109764:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b6a7d9d/0x8ebaae74e82172b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.109778:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b6a7d9d/0x8ebaae74e82172b8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.109785:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b6a7d9d/0x8ebaae74e82172b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.109800:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.109802:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.109803:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789478652.110010:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789478652.110016:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8bd528c/0x8ebaae74e82172bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.110025:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=481s v=(0 0) 00010000:00010000:0.0:1789478652.110029:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478652.110033:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8bd528c/0x8ebaae74e82172bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.110043:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8bd528c/0x8ebaae74e82172bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.110050:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8bd528c/0x8ebaae74e82172bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.110063:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8bd528c/0x8ebaae74e82172bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.110076:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789478652.110170:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789478652.110175:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8bd528c/0x8ebaae74e82172bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.110182:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40f05200 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:0.0:1789478652.110185:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8bd528c/0x8ebaae74e82172bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.110193:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8bd528c/0x8ebaae74e82172bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.110204:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8bd528c/0x8ebaae74e82172bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.110210:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8bd528c/0x8ebaae74e82172bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.110221:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478652.110222:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478652.110224:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478652.110245:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789478652.112103:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789478652.112113:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ace75ca1/0x8ebaae74e82172c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112141:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=481s v=(0 0) 00002000:00010000:3.0:1789478652.112142:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789478652.112145:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478652.112147:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2fae712/0x8ebaae74e82172cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112150:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ace75ca1/0x8ebaae74e82172c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.112156:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1789478652.112158:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478652.112162:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2fae712/0x8ebaae74e82172cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112163:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ace75ca1/0x8ebaae74e82172c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.112171:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2fae712/0x8ebaae74e82172cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112172:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ace75ca1/0x8ebaae74e82172c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.112180:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2fae712/0x8ebaae74e82172cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112181:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ace75ca1/0x8ebaae74e82172c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.112192:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2fae712/0x8ebaae74e82172cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112197:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789478652.112203:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789478652.112207:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789478652.112212:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ace75ca1/0x8ebaae74e82172c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112219:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40f05000 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:0.0:1789478652.112223:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ace75ca1/0x8ebaae74e82172c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112241:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ace75ca1/0x8ebaae74e82172c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112254:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ace75ca1/0x8ebaae74e82172c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112260:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ace75ca1/0x8ebaae74e82172c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112287:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789478652.112290:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2fae712/0x8ebaae74e82172cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112296:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd600 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:0.0:1789478652.112299:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2fae712/0x8ebaae74e82172cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112306:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2fae712/0x8ebaae74e82172cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112316:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2fae712/0x8ebaae74e82172cd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112323:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2fae712/0x8ebaae74e82172cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112348:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478652.112350:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478652.112351:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478652.112357:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789478652.112760:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789478652.112766:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082696efe/0x8ebaae74e82172d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.112775:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1789478652.112778:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478652.112782:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082696efe/0x8ebaae74e82172d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.112791:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082696efe/0x8ebaae74e82172d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789478652.112797:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789478652.112799:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082696efe/0x8ebaae74e82172d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112802:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000921b9410/0x8ebaae74e82172db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.112806:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082696efe/0x8ebaae74e82172d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112810:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=481s v=(0 0) 00010000:00010000:0.0:1789478652.112812:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478652.112816:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000921b9410/0x8ebaae74e82172db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.112824:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789478652.112826:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000921b9410/0x8ebaae74e82172db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112834:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000921b9410/0x8ebaae74e82172db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112840:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000921b9410/0x8ebaae74e82172db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112851:0:18393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789478652.112855:0:18393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082696efe/0x8ebaae74e82172d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112873:0:18393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fce00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:0.0:1789478652.112876:0:18393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082696efe/0x8ebaae74e82172d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112884:0:18393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082696efe/0x8ebaae74e82172d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112895:0:18393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082696efe/0x8ebaae74e82172d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.112902:0:18393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082696efe/0x8ebaae74e82172d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.113097:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478652.113100:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478652.113102:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478652.113114:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789478652.113242:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789478652.113247:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000921b9410/0x8ebaae74e82172db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.113261:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40f05e00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478652.113265:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000921b9410/0x8ebaae74e82172db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.113273:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000921b9410/0x8ebaae74e82172db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.113284:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000921b9410/0x8ebaae74e82172db lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.113292:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000921b9410/0x8ebaae74e82172db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.113306:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.113308:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.113309:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789478652.113475:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789478652.113481:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1e60ef6/0x8ebaae74e82172e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.113490:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=481s v=(0 0) 00010000:00010000:0.0:1789478652.113493:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478652.113498:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1e60ef6/0x8ebaae74e82172e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.113518:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1e60ef6/0x8ebaae74e82172e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.113526:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1e60ef6/0x8ebaae74e82172e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.113534:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1e60ef6/0x8ebaae74e82172e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.113547:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789478652.113554:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789478652.113558:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1e60ef6/0x8ebaae74e82172e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.113564:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40f04e00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:0.0:1789478652.113567:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1e60ef6/0x8ebaae74e82172e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.113574:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1e60ef6/0x8ebaae74e82172e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.113584:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1e60ef6/0x8ebaae74e82172e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.113614:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1e60ef6/0x8ebaae74e82172e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.113643:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478652.113645:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478652.113647:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789478652.113818:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789478652.113824:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e13f171/0x8ebaae74e82172e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.113832:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1789478652.113835:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478652.113839:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e13f171/0x8ebaae74e82172e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.113848:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e13f171/0x8ebaae74e82172e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.113863:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e13f171/0x8ebaae74e82172e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.113870:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e13f171/0x8ebaae74e82172e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.113885:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789478652.114187:0:18393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789478652.114192:0:18393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e13f171/0x8ebaae74e82172e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.114200:0:18393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fc400 already unused, calling callback (ffffffffc0d672a0) 00002000:00010000:3.0:1789478652.114201:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789478652.114203:0:18393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e13f171/0x8ebaae74e82172e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.114207:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6eaa1db/0x8ebaae74e82172f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.114212:0:18393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e13f171/0x8ebaae74e82172e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.114215:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1789478652.114218:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478652.114221:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6eaa1db/0x8ebaae74e82172f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.114223:0:18393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e13f171/0x8ebaae74e82172e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.114231:0:18393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e13f171/0x8ebaae74e82172e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.114232:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6eaa1db/0x8ebaae74e82172f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.114239:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6eaa1db/0x8ebaae74e82172f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.114244:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478652.114246:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.114247:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6eaa1db/0x8ebaae74e82172f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.114248:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.114269:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789478652.114276:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789478652.114280:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6eaa1db/0x8ebaae74e82172f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.114286:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fc000 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478652.114289:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6eaa1db/0x8ebaae74e82172f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.114296:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6eaa1db/0x8ebaae74e82172f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.114307:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6eaa1db/0x8ebaae74e82172f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.114314:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6eaa1db/0x8ebaae74e82172f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.114328:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.114329:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.114331:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789478652.114763:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789478652.114769:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000661d0490/0x8ebaae74e82172f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.114787:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=481s v=(0 0) 00010000:00010000:0.0:1789478652.114791:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478652.114795:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000661d0490/0x8ebaae74e82172f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.114804:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000661d0490/0x8ebaae74e82172f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.114812:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000661d0490/0x8ebaae74e82172f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.114819:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000661d0490/0x8ebaae74e82172f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.114836:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789478652.114916:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789478652.114921:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000661d0490/0x8ebaae74e82172f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.114929:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40f04400 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478652.114938:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000661d0490/0x8ebaae74e82172f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.114946:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000661d0490/0x8ebaae74e82172f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.114957:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000661d0490/0x8ebaae74e82172f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.114964:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000661d0490/0x8ebaae74e82172f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.114978:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.114980:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.114982:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789478652.115017:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789478652.115023:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fadb1aed/0x8ebaae74e82172fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.115031:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1789478652.115034:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478652.115038:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fadb1aed/0x8ebaae74e82172fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.115047:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fadb1aed/0x8ebaae74e82172fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.115056:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fadb1aed/0x8ebaae74e82172fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.115068:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fadb1aed/0x8ebaae74e82172fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.115095:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789478652.115555:0:18393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789478652.115560:0:18393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fadb1aed/0x8ebaae74e82172fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.115568:0:18393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029df200 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:0.0:1789478652.115572:0:18393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fadb1aed/0x8ebaae74e82172fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.115579:0:18393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fadb1aed/0x8ebaae74e82172fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.115640:0:18393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fadb1aed/0x8ebaae74e82172fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.115648:0:18393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fadb1aed/0x8ebaae74e82172fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.115663:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478652.115665:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478652.115666:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789478652.115703:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789478652.115708:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026aa1d2f/0x8ebaae74e8217305 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.115716:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=481s v=(0 0) 00010000:00010000:0.0:1789478652.115719:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478652.115722:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026aa1d2f/0x8ebaae74e8217305 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.115731:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026aa1d2f/0x8ebaae74e8217305 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.115739:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026aa1d2f/0x8ebaae74e8217305 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.115746:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026aa1d2f/0x8ebaae74e8217305 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.115776:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789478652.116555:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478652.116562:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026aa1d2f/0x8ebaae74e8217305 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.116570:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40f04600 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478652.116574:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026aa1d2f/0x8ebaae74e8217305 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.116583:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026aa1d2f/0x8ebaae74e8217305 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.116634:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026aa1d2f/0x8ebaae74e8217305 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.116642:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026aa1d2f/0x8ebaae74e8217305 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.116657:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.116659:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.116661:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789478652.116769:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789478652.116776:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc751f79/0x8ebaae74e821730c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.116785:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=481s v=(0 0) 00010000:00010000:0.0:1789478652.116788:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478652.116792:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc751f79/0x8ebaae74e821730c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.116804:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc751f79/0x8ebaae74e821730c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.116813:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc751f79/0x8ebaae74e821730c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.116821:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc751f79/0x8ebaae74e821730c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.116844:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789478652.117037:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789478652.117043:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000055445c8/0x8ebaae74e8217313 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.117051:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=481s v=(0 0) 00010000:00010000:1.0:1789478652.117053:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478652.117057:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000055445c8/0x8ebaae74e8217313 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.117066:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000055445c8/0x8ebaae74e8217313 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.117085:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000055445c8/0x8ebaae74e8217313 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.117092:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000055445c8/0x8ebaae74e8217313 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.117257:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789478652.117259:0:18393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789478652.117265:0:18393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc751f79/0x8ebaae74e821730c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.117273:0:18393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40f05600 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478652.117276:0:18393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc751f79/0x8ebaae74e821730c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.117284:0:18393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc751f79/0x8ebaae74e821730c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.117296:0:18393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc751f79/0x8ebaae74e821730c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.117303:0:18393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc751f79/0x8ebaae74e821730c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.117319:0:18393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789478652.117322:0:18393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000055445c8/0x8ebaae74e8217313 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.117338:0:18393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcf400 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478652.117341:0:18393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000055445c8/0x8ebaae74e8217313 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.117349:0:18393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000055445c8/0x8ebaae74e8217313 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.117360:0:18393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000055445c8/0x8ebaae74e8217313 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.117367:0:18393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000055445c8/0x8ebaae74e8217313 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.117379:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.117381:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.117383:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.117436:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789478652.117844:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789478652.117850:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e821731a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.117859:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789478652.117862:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478652.117867:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e821731a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.117878:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e821731a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.117887:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e821731a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.117893:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e821731a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789478652.118701:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789478652.118709:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cbc0e46/0x8ebaae74e8217321 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.118719:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=481s v=(0 0) 00010000:00010000:1.0:1789478652.118723:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478652.118727:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cbc0e46/0x8ebaae74e8217321 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.118743:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cbc0e46/0x8ebaae74e8217321 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.118753:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cbc0e46/0x8ebaae74e8217321 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.118760:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cbc0e46/0x8ebaae74e8217321 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.118914:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789478652.118921:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e821731a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.118929:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76e00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478652.118933:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e821731a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.118941:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e821731a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.118962:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e821731a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.118971:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789478652.118974:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cbc0e46/0x8ebaae74e8217321 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.118980:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcf200 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478652.118983:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cbc0e46/0x8ebaae74e8217321 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.118991:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cbc0e46/0x8ebaae74e8217321 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.119000:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cbc0e46/0x8ebaae74e8217321 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.119007:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.119008:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.119010:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478652.119069:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789478652.119074:0:19739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cbc0e46/0x8ebaae74e8217321 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789478652.119107:0:19559:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:3.0:1789478652.119160:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789478652.119189:0:19559:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789478652.119194:0:19559:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789478652.119445:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17982:x1876403964530432:12345-0@lo:5:osp-pre-1-1.0 Request processed in 76232us (76284us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789478652.119454:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1789478652.119743:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000100:00100000:3.0:1789478652.119747:0:17982:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00010000:00010000:2.0:1789478652.119750:0:18747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e821731a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478652.119753:0:17982:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f3a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17982:1876403964530432:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789478652.119774:0:17982:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789478652.119819:0:17982:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f3a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17982:1876403964530560:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789478652.119852:0:17982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478652.119881:0:17982:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc012ed780 going to sleep for 11 seconds 00000100:00100000:2.0:1789478652.120064:0:17249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964530560 00000100:00100000:2.0:1789478652.120070:0:17249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964530560 00000100:00100000:2.0:1789478652.120207:0:17249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789478652.120216:0:17249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17982:x1876403964530560:12345-0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1789478652.120307:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789478652.120314:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d7abbdb/0x8ebaae74e8217328 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.120330:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=481s v=(0 0) 00010000:00010000:0.0:1789478652.120335:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478652.120340:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d7abbdb/0x8ebaae74e8217328 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.120351:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d7abbdb/0x8ebaae74e8217328 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.120361:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d7abbdb/0x8ebaae74e8217328 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.120367:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d7abbdb/0x8ebaae74e8217328 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478652.120375:0:17249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17982:x1876403964530560:12345-0@lo:900:osp-pre-1-1.0 Request processed in 161us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478652.120383:0:17249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789478652.120388:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789478652.120429:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789478652.120434:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bdc8a35/0x8ebaae74e821732f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.120442:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789478652.120445:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478652.120448:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bdc8a35/0x8ebaae74e821732f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.120458:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bdc8a35/0x8ebaae74e821732f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.120465:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bdc8a35/0x8ebaae74e821732f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.120518:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789478652.120590:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d7abbdb/0x8ebaae74e8217328 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.120635:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40f05400 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:1.0:1789478652.120640:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d7abbdb/0x8ebaae74e8217328 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.120649:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d7abbdb/0x8ebaae74e8217328 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.120662:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d7abbdb/0x8ebaae74e8217328 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.120668:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d7abbdb/0x8ebaae74e8217328 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.120684:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bdc8a35/0x8ebaae74e821732f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.120684:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478652.120686:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478652.120687:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.120701:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789478652.120805:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789478652.120811:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bdc8a35/0x8ebaae74e821732f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.120818:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77600 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:0.0:1789478652.120821:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bdc8a35/0x8ebaae74e821732f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.120829:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bdc8a35/0x8ebaae74e821732f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.120850:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bdc8a35/0x8ebaae74e821732f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.120858:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bdc8a35/0x8ebaae74e821732f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.120872:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478652.120873:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478652.120875:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789478652.121169:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789478652.121175:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb0ddcb9/0x8ebaae74e8217336 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.121183:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789478652.121186:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478652.121189:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb0ddcb9/0x8ebaae74e8217336 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.121198:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb0ddcb9/0x8ebaae74e8217336 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.121204:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb0ddcb9/0x8ebaae74e8217336 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.121211:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb0ddcb9/0x8ebaae74e8217336 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.121226:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1789478652.121251:0:17982:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03f3a300 x1876403964530560/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789478668 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478652.121264:0:17982:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f3a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17982:1876403964530560:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1789478652.121354:0:18393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789478652.121359:0:18393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb0ddcb9/0x8ebaae74e8217336 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.121367:0:18393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76a00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:0.0:1789478652.121370:0:18393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb0ddcb9/0x8ebaae74e8217336 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.121377:0:18393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb0ddcb9/0x8ebaae74e8217336 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.121391:0:18393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb0ddcb9/0x8ebaae74e8217336 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.121423:0:18393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb0ddcb9/0x8ebaae74e8217336 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.121445:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478652.121446:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478652.121448:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789478652.121740:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789478652.121756:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0ad4510/0x8ebaae74e821733d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.121764:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=481s v=(0 0) 00010000:00010000:1.0:1789478652.121767:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478652.121771:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0ad4510/0x8ebaae74e821733d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.121779:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0ad4510/0x8ebaae74e821733d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.121786:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0ad4510/0x8ebaae74e821733d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.121792:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0ad4510/0x8ebaae74e821733d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.121802:0:19739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789478652.121925:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478652.121930:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0ad4510/0x8ebaae74e821733d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1789478652.121934:0:19739:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00010000:00010000:2.0:1789478652.121942:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcf600 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478652.121945:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0ad4510/0x8ebaae74e821733d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.121952:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0ad4510/0x8ebaae74e821733d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.121962:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0ad4510/0x8ebaae74e821733d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.121968:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0ad4510/0x8ebaae74e821733d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.121981:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.121983:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.121984:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478652.122005:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17265:x1876403964530176:12345-0@lo:5:osp-pre-1-0.0 Request processed in 100954us (101314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478652.122013:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789478652.122174:0:17265:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03feed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17265:1876403964530176:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789478652.122186:0:17265:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1789478652.122221:0:17265:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03feed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17265:1876403964530688:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789478652.122256:0:17265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478652.122354:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964530688 00000100:00100000:2.0:1789478652.122360:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964530688 00000100:00100000:0.0:1789478652.122364:0:17265:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc3c8a6a80 going to sleep for 11 seconds 00002000:00010000:0.0:1789478652.122409:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789478652.122415:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055d7fa12/0x8ebaae74e8217344 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.122423:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=481s v=(0 0) 00010000:00010000:0.0:1789478652.122427:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1789478652.122429:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1789478652.122431:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055d7fa12/0x8ebaae74e8217344 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478652.122438:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17265:x1876403964530688:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:0.0:1789478652.122441:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055d7fa12/0x8ebaae74e8217344 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.122448:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055d7fa12/0x8ebaae74e8217344 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.122454:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055d7fa12/0x8ebaae74e8217344 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1789478652.122468:0:18748:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:0.0:1789478652.122511:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789478652.122972:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789478652.122982:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055d7fa12/0x8ebaae74e8217344 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.122991:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40f04c00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:1.0:1789478652.123002:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055d7fa12/0x8ebaae74e8217344 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.123010:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055d7fa12/0x8ebaae74e8217344 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.123023:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055d7fa12/0x8ebaae74e8217344 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.123031:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055d7fa12/0x8ebaae74e8217344 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.123068:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.123071:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.123073:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789478652.123153:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789478652.123159:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e60ef6/0x8ebaae74e821734b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.123169:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=481s v=(0 0) 00010000:00010000:0.0:1789478652.123172:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478652.123176:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e60ef6/0x8ebaae74e821734b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.123185:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e60ef6/0x8ebaae74e821734b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.123192:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e60ef6/0x8ebaae74e821734b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.123200:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e60ef6/0x8ebaae74e821734b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478652.123277:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789478652.123519:0:18393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789478652.123689:0:18393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e60ef6/0x8ebaae74e821734b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.123698:0:18393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40f04e00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478652.123702:0:18393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e60ef6/0x8ebaae74e821734b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.123711:0:18393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e60ef6/0x8ebaae74e821734b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.123722:0:18393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e60ef6/0x8ebaae74e821734b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.123729:0:18393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e60ef6/0x8ebaae74e821734b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.123743:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.123751:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.123753:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789478652.123902:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789478652.123909:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004265e6b7/0x8ebaae74e8217352 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.123925:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789478652.123929:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478652.123933:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004265e6b7/0x8ebaae74e8217352 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.123943:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004265e6b7/0x8ebaae74e8217352 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.123951:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004265e6b7/0x8ebaae74e8217352 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.123958:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004265e6b7/0x8ebaae74e8217352 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.124031:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789478652.124266:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789478652.124479:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004265e6b7/0x8ebaae74e8217352 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.124487:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77000 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:1.0:1789478652.124731:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004265e6b7/0x8ebaae74e8217352 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.124741:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004265e6b7/0x8ebaae74e8217352 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.124752:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004265e6b7/0x8ebaae74e8217352 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.124759:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004265e6b7/0x8ebaae74e8217352 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.124778:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478652.124780:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478652.124782:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789478652.124810:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789478652.124816:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8217359 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.124824:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789478652.124828:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478652.124832:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8217359 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.124842:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8217359 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.124861:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8217359 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.124867:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8217359 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.124921:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789478652.125025:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789478652.125031:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8217359 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.125039:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76e00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478652.125042:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8217359 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.125049:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8217359 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.125060:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8217359 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.125067:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074fcd2f0/0x8ebaae74e8217359 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.125081:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.125083:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.125085:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789478652.125553:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789478652.125559:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1600edc/0x8ebaae74e8217360 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.125568:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789478652.125572:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478652.125576:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1600edc/0x8ebaae74e8217360 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.125586:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1600edc/0x8ebaae74e8217360 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.125637:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1600edc/0x8ebaae74e8217360 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.125644:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1600edc/0x8ebaae74e8217360 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.125671:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789478652.125884:0:18393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789478652.125889:0:18393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1600edc/0x8ebaae74e8217360 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.125897:0:18393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76800 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478652.125901:0:18393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1600edc/0x8ebaae74e8217360 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.125916:0:18393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1600edc/0x8ebaae74e8217360 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.125929:0:18393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1600edc/0x8ebaae74e8217360 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.125936:0:18393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1600edc/0x8ebaae74e8217360 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.125951:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.125952:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.125954:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789478652.126163:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789478652.126169:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1daea95/0x8ebaae74e8217367 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.126178:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789478652.126182:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478652.126186:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1daea95/0x8ebaae74e8217367 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.126195:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1daea95/0x8ebaae74e8217367 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.126203:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1daea95/0x8ebaae74e8217367 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.126210:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1daea95/0x8ebaae74e8217367 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.126264:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789478652.126662:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789478652.126669:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000758ee613/0x8ebaae74e821736e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.126677:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789478652.126688:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478652.126692:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000758ee613/0x8ebaae74e821736e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.126701:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000758ee613/0x8ebaae74e821736e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.126709:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000758ee613/0x8ebaae74e821736e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.126716:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000758ee613/0x8ebaae74e821736e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.126854:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789478652.126861:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1daea95/0x8ebaae74e8217367 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.126868:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f76c00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:1.0:1789478652.126875:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1daea95/0x8ebaae74e8217367 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.126882:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1daea95/0x8ebaae74e8217367 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.126892:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1daea95/0x8ebaae74e8217367 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.126899:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1daea95/0x8ebaae74e8217367 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.126911:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789478652.126915:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000758ee613/0x8ebaae74e821736e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.126921:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77c00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:1.0:1789478652.126933:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000758ee613/0x8ebaae74e821736e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.126940:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000758ee613/0x8ebaae74e821736e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.126950:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000758ee613/0x8ebaae74e821736e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.126958:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478652.126959:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478652.126961:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.127024:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789478652.127031:0:18747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000758ee613/0x8ebaae74e821736e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789478652.127503:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789478652.127509:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a4eb253/0x8ebaae74e8217375 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.127518:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789478652.127521:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478652.127536:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a4eb253/0x8ebaae74e8217375 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.127546:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a4eb253/0x8ebaae74e8217375 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.127560:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a4eb253/0x8ebaae74e8217375 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.127567:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a4eb253/0x8ebaae74e8217375 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.127678:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789478652.127685:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a4eb253/0x8ebaae74e8217375 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.127692:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4b600 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:3.0:1789478652.127696:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a4eb253/0x8ebaae74e8217375 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.127704:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a4eb253/0x8ebaae74e8217375 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.127716:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a4eb253/0x8ebaae74e8217375 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.127735:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.127736:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.127738:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478652.128986:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17265:x1876403964530688:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6542us (6723us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789478652.128996:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789478652.129229:0:17265:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03feed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17265:1876403964530688:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789478652.129243:0:17265:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:2.0:1789478652.129341:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789478652.129358:0:18747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a4eb253/0x8ebaae74e8217375 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.129473:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789478652.130237:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789478652.130246:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cb56bf0/0x8ebaae74e821737c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.130259:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1789478652.130263:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478652.130268:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cb56bf0/0x8ebaae74e821737c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.130281:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cb56bf0/0x8ebaae74e821737c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.130290:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cb56bf0/0x8ebaae74e821737c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.130298:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cb56bf0/0x8ebaae74e821737c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.130361:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789478652.130824:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789478652.130831:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fadb1aed/0x8ebaae74e8217383 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.130839:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1789478652.130843:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478652.130847:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fadb1aed/0x8ebaae74e8217383 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.130855:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fadb1aed/0x8ebaae74e8217383 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.130862:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fadb1aed/0x8ebaae74e8217383 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.130869:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fadb1aed/0x8ebaae74e8217383 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.130935:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789478652.130942:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cb56bf0/0x8ebaae74e821737c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.130950:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029dfa00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:1.0:1789478652.130964:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cb56bf0/0x8ebaae74e821737c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.130974:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cb56bf0/0x8ebaae74e821737c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.130987:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cb56bf0/0x8ebaae74e821737c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.131005:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cb56bf0/0x8ebaae74e821737c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.131023:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789478652.131026:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fadb1aed/0x8ebaae74e8217383 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.131031:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc029df200 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:1.0:1789478652.131034:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fadb1aed/0x8ebaae74e8217383 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.131040:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fadb1aed/0x8ebaae74e8217383 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.131049:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fadb1aed/0x8ebaae74e8217383 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.131055:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478652.131056:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478652.131059:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.131278:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789478652.131284:0:18747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fadb1aed/0x8ebaae74e8217383 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789478652.131727:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789478652.131734:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e70eea2/0x8ebaae74e821738a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.131743:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1789478652.131754:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478652.131758:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e70eea2/0x8ebaae74e821738a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.131768:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e70eea2/0x8ebaae74e821738a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.131776:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e70eea2/0x8ebaae74e821738a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.131783:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e70eea2/0x8ebaae74e821738a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.131841:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478652.131848:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e70eea2/0x8ebaae74e821738a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.131856:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b66a00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478652.131859:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e70eea2/0x8ebaae74e821738a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.131867:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e70eea2/0x8ebaae74e821738a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.131878:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e70eea2/0x8ebaae74e821738a lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.131886:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.131893:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.131895:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.132077:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789478652.132082:0:18747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e70eea2/0x8ebaae74e821738a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789478652.132422:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789478652.132429:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004974a718/0x8ebaae74e8217391 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.132443:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=481s v=(0 0) 00010000:00010000:0.0:1789478652.132444:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.132446:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478652.132450:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004974a718/0x8ebaae74e8217391 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.132460:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004974a718/0x8ebaae74e8217391 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.132474:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004974a718/0x8ebaae74e8217391 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.132482:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004974a718/0x8ebaae74e8217391 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.132854:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789478652.133342:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789478652.133349:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004974a718/0x8ebaae74e8217391 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.133359:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67600 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:1.0:1789478652.133371:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004974a718/0x8ebaae74e8217391 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.133379:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004974a718/0x8ebaae74e8217391 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.133392:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004974a718/0x8ebaae74e8217391 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.133398:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004974a718/0x8ebaae74e8217391 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.133413:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478652.133414:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478652.133416:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789478652.133700:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789478652.133706:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0a8e614/0x8ebaae74e8217398 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.133715:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1789478652.133718:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478652.133723:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0a8e614/0x8ebaae74e8217398 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.133732:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0a8e614/0x8ebaae74e8217398 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.133739:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0a8e614/0x8ebaae74e8217398 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.133746:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0a8e614/0x8ebaae74e8217398 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.133773:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789478652.133985:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478652.133992:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0a8e614/0x8ebaae74e8217398 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.134000:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b66c00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478652.134004:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0a8e614/0x8ebaae74e8217398 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.134012:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0a8e614/0x8ebaae74e8217398 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.134024:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0a8e614/0x8ebaae74e8217398 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.134031:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0a8e614/0x8ebaae74e8217398 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.134045:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.134047:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.134048:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789478652.134063:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789478652.134291:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789478652.134297:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5b3b73a/0x8ebaae74e821739f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.134305:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1789478652.134308:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478652.134311:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5b3b73a/0x8ebaae74e821739f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.134320:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5b3b73a/0x8ebaae74e821739f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.134328:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5b3b73a/0x8ebaae74e821739f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.134336:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5b3b73a/0x8ebaae74e821739f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.134353:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789478652.134698:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789478652.134703:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5b3b73a/0x8ebaae74e821739f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.134712:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b66200 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:1.0:1789478652.134715:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5b3b73a/0x8ebaae74e821739f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.134724:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5b3b73a/0x8ebaae74e821739f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.134738:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5b3b73a/0x8ebaae74e821739f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.134751:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5b3b73a/0x8ebaae74e821739f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.134766:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478652.134768:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478652.134770:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789478652.134870:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789478652.134876:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce317a75/0x8ebaae74e82173a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.134885:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1789478652.134894:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478652.134898:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce317a75/0x8ebaae74e82173a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.134908:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce317a75/0x8ebaae74e82173a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.134915:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce317a75/0x8ebaae74e82173a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.134923:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce317a75/0x8ebaae74e82173a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.135065:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789478652.135410:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789478652.135416:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cafe8bdf/0x8ebaae74e82173ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.135425:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1789478652.135428:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478652.135431:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cafe8bdf/0x8ebaae74e82173ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.135440:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cafe8bdf/0x8ebaae74e82173ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.135447:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cafe8bdf/0x8ebaae74e82173ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478652.135460:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cafe8bdf/0x8ebaae74e82173ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.135493:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789478652.135499:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce317a75/0x8ebaae74e82173a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.135506:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67200 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478652.135509:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce317a75/0x8ebaae74e82173a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.135533:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce317a75/0x8ebaae74e82173a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.135546:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce317a75/0x8ebaae74e82173a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.135552:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce317a75/0x8ebaae74e82173a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.135568:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789478652.135571:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cafe8bdf/0x8ebaae74e82173ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.135577:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67000 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478652.135580:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cafe8bdf/0x8ebaae74e82173ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.135588:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cafe8bdf/0x8ebaae74e82173ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.135636:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cafe8bdf/0x8ebaae74e82173ad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478652.135644:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.135646:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789478652.135655:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789478652.135817:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789478652.135822:0:18747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cafe8bdf/0x8ebaae74e82173ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789478652.137829:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789478652.137841:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cbc0e46/0x8ebaae74e82173b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.137856:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=481s v=(0 0) 00010000:00010000:1.0:1789478652.137859:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789478652.137865:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cbc0e46/0x8ebaae74e82173b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.137876:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cbc0e46/0x8ebaae74e82173b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.137885:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cbc0e46/0x8ebaae74e82173b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.137891:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cbc0e46/0x8ebaae74e82173b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.137908:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789478652.137917:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789478652.137928:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cbc0e46/0x8ebaae74e82173b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.137935:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcf200 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:1.0:1789478652.137939:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cbc0e46/0x8ebaae74e82173b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.137947:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cbc0e46/0x8ebaae74e82173b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.138201:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cbc0e46/0x8ebaae74e82173b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.138209:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cbc0e46/0x8ebaae74e82173b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478652.138224:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478652.138226:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478652.138227:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789478652.138299:0:18747:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:1.0:1789478652.138389:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17263:x1876403964529664:12345-0@lo:5:osp-pre-0-0.0 Request processed in 123828us (127511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478652.138398:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789478652.138457:0:17263:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17263:1876403964529664:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789478652.138471:0:17263:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:1.0:1789478652.138515:0:17263:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17263:1876403964530816:0@lo:5:osp-pre-0-0.0 00010000:00010000:0.0:1789478652.139077:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478652.139242:0:17263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478652.139310:0:17263:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05045480 going to sleep for 11 seconds 00000100:00100000:1.0:1789478652.139328:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964530816 00000100:00100000:1.0:1789478652.139334:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964530816 00000100:00100000:2.0:1789478652.139442:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789478652.139453:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17263:x1876403964530816:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789478652.139495:0:18746:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:1.0:1789478652.151611:0:18742:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1789478652.151668:0:18742:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789478652.151947:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17263:x1876403964530816:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12491us (12700us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789478652.151957:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789478652.152400:0:17263:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1789478652.152410:0:17263:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17263:1876403964530816:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789478652.152425:0:17263:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000040:00080000:0.0:1789478652.328883:0:17992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789478653.156764:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478654.181325:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789478654.794961:0:19915:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789478655.204714:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789478655.649964:0:19967:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789478655.650182:0:19967:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789478655.723799:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964530944:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789478655.723946:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478655.728120:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964530944 00000100:00100000:3.0:1789478655.728134:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964530944 00000100:00100000:2.0:1789478655.733414:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789478655.733429:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964530944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789478655.733460:0:18750:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789478655.733550:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964530944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (9604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478655.733558:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789478655.733649:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964530944:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789478655.733800:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789478656.229442:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478656.230437:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964531072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478656.230525:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478656.230827:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964531072 00000100:00100000:3.0:1789478656.230835:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964531072 00000100:00100000:3.0:1789478656.230892:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789478656.230902:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964531072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789478656.230938:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789478656.230990:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876403964531072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478656.230998:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789478656.233856:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876403964531072:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1789478656.475230:0:20017:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789478656.475475:0:20017:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789478656.741650:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964531200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789478656.741734:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478656.742080:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964531200 00000100:00100000:3.0:1789478656.742088:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964531200 00000100:00100000:3.0:1789478656.742144:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789478656.742155:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964531200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789478656.742191:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789478656.751375:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964531200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9213us (9631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478656.751404:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789478656.754310:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478656.754481:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945585536 00000100:00100000:3.0:1789478656.754492:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945585536 00000100:00100000:3.0:1789478656.754536:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 113 00000100:00100000:3.0:1789478656.754544:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2394:x1876403945585536:12345-192.168.206.11@tcp:250:mount.lustre.0 00010000:00080000:3.0:1789478656.754573:0:17233:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 3bfa9933-6ffc-43b1-8c4f-3d477dd92578@192.168.206.11@tcp t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:3.0:1789478656.754624:0:17233:0:(genops.c:1385:class_connect()) connect: client 3bfa9933-6ffc-43b1-8c4f-3d477dd92578, cookie 0x8ebaae74e82173bb 00000100:00080000:3.0:1789478656.754762:0:17233:0:(import.c:65:import_set_state_nolock()) ffff8ebb0205c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789478656.754916:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+5:2394:x1876403945585536:12345-192.168.206.11@tcp:250:mount.lustre.0 Request processed in 369us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478656.754924:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 113 00000100:00100000:0.0:1789478656.761825:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964531200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789478656.766256:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478656.766570:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945585664 00000100:00100000:0.0:1789478656.766579:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945585664 00000100:00100000:0.0:1789478656.766671:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 114 00000100:00100000:0.0:1789478656.766683:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+5:14890:x1876403945585664:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789478656.766698:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478656.766715:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40f04a00/0x8ebaae74e82173c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7682 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478656.766744:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40f04a00/0x8ebaae74e82173c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7682 expref: 6 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478656.766753:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40f04a00/0x8ebaae74e82173c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7682 expref: 6 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478656.766761:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40f04a00, rc 0) 00000100:00100000:0.0:1789478656.766821:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+6:14890:x1876403945585664:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 140us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478656.766826:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 114 00000100:00100000:1.0:1789478656.776387:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478656.776478:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945585792 00000100:00100000:3.0:1789478656.776491:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945585792 00000100:00100000:3.0:1789478656.776549:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 115 00000100:00100000:3.0:1789478656.776562:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+6:14890:x1876403945585792:12345-192.168.206.11@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789478656.776757:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+6:14890:x1876403945585792:12345-192.168.206.11@tcp:501:mount.lustre.0 Request processed in 198us (381us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789478656.776766:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 115 00000100:00100000:1.0:1789478656.780311:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478656.780456:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945585920 00000100:00100000:2.0:1789478656.780465:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945585920 00000100:00100000:2.0:1789478656.780523:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 116 00000100:00100000:2.0:1789478656.780533:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+6:14890:x1876403945585920:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789478656.780549:0:17232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478656.780569:0:17232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc08c4ba00/0x8ebaae74e82173c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7689 expref: -99 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478656.780634:0:17232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc08c4ba00/0x8ebaae74e82173c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7689 expref: 7 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478656.780661:0:17232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc08c4ba00/0x8ebaae74e82173c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7689 expref: 7 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478656.780672:0:17232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4ba00, rc 0) 00000100:00100000:2.0:1789478656.780730:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+7:14890:x1876403945585920:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 199us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478656.780737:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 116 00000100:00100000:2.0:1789478656.785075:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478656.785323:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945586048 00000100:00100000:0.0:1789478656.785334:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945586048 00000100:00100000:0.0:1789478656.785392:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 117 00000100:00100000:0.0:1789478656.785402:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+7:14890:x1876403945586048:12345-192.168.206.11@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789478656.785568:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+8:14890:x1876403945586048:12345-192.168.206.11@tcp:501:mount.lustre.0 Request processed in 167us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478656.785576:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 117 00000100:00100000:1.0:1789478656.791709:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478656.791792:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945586176 00000100:00100000:3.0:1789478656.791802:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945586176 00000100:00100000:3.0:1789478656.791845:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 118 00000100:00100000:3.0:1789478656.791854:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+8:14890:x1876403945586176:12345-192.168.206.11@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789478656.791989:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+8:14890:x1876403945586176:12345-192.168.206.11@tcp:503:mount.lustre.0 Request processed in 135us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478656.791997:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 118 00000100:00100000:1.0:1789478656.803474:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478656.803768:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945586304 00000100:00100000:2.0:1789478656.803778:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945586304 00000100:00100000:2.0:1789478656.803823:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 119 00000100:00100000:2.0:1789478656.803832:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+8:14909:x1876403945586304:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789478656.803969:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+8:14909:x1876403945586304:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 137us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478656.803977:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 119 00000100:00100000:2.0:1789478656.841673:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478656.841762:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945586432 00000100:00100000:0.0:1789478656.841773:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945586432 00000100:00100000:0.0:1789478656.841832:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 120 00000100:00100000:0.0:1789478656.841844:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+8:14909:x1876403945586432:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789478656.841997:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+8:14909:x1876403945586432:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 154us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478656.842006:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 120 00000100:00100000:1.0:1789478656.845194:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478656.845551:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945586560 00000100:00100000:3.0:1789478656.845561:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945586560 00000100:00100000:3.0:1789478656.845697:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 121 00000100:00100000:3.0:1789478656.845707:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+8:14909:x1876403945586560:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789478656.845849:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+8:14909:x1876403945586560:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 143us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478656.845857:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 121 00000100:00100000:1.0:1789478656.848926:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478656.849517:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945586688 00000100:00100000:2.0:1789478656.849528:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945586688 00000100:00100000:2.0:1789478656.849585:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 122 00000100:00100000:2.0:1789478656.849626:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb036c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+8:14890:x1876403945586688:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789478656.849641:0:17232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478656.849657:0:17232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc08c4bc00/0x8ebaae74e82173d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b76ba expref: -99 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478656.849681:0:17232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc08c4bc00/0x8ebaae74e82173d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b76ba expref: 9 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478656.849704:0:17232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc08c4bc00/0x8ebaae74e82173d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b76ba expref: 9 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478656.849713:0:17232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4bc00, rc 0) 00000100:00100000:2.0:1789478656.849769:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb036c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+9:14890:x1876403945586688:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 175us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478656.849777:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 122 00000100:00100000:2.0:1789478656.856037:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478656.856282:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945586816 00000100:00100000:3.0:1789478656.856359:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945586816 00000100:00100000:3.0:1789478656.856446:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 123 00000100:00100000:3.0:1789478656.856465:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc38e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+9:14890:x1876403945586816:12345-192.168.206.11@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789478656.856491:0:17233:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789478656.856513:0:17233:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789478656.856518:0:17233:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789478656.856520:0:17233:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789478656.856523:0:17233:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789478656.856526:0:17233:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1789478656.858809:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc38e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+9:14890:x1876403945586816:12345-192.168.206.11@tcp:256:mount.lustre.0 Request processed in 2335us (2770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478656.858823:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 123 00000100:00100000:1.0:1789478656.862304:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478656.862758:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945586944 00000100:00100000:0.0:1789478656.862767:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945586944 00000100:00100000:0.0:1789478656.862823:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 124 00000100:00100000:0.0:1789478656.862833:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc38e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+9:14890:x1876403945586944:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789478656.862848:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478656.862863:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82173d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b76c1 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478656.862888:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82173d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b76c1 expref: 10 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478656.862899:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82173d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b76c1 expref: 10 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478656.862908:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40f05a00, rc 0) 00000100:00100000:0.0:1789478656.862957:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc38e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+10:14890:x1876403945586944:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 126us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478656.862976:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 124 00000100:00100000:0.0:1789478656.866826:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478656.866920:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945587072 00000100:00100000:3.0:1789478656.866931:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945587072 00000100:00100000:3.0:1789478656.866987:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 125 00000100:00100000:3.0:1789478656.866998:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc38e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+10:14890:x1876403945587072:12345-192.168.206.11@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789478656.867198:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc38e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+10:14890:x1876403945587072:12345-192.168.206.11@tcp:501:mount.lustre.0 Request processed in 202us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478656.867223:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 125 00000100:00100000:1.0:1789478656.872424:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478656.872542:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945587200 00000100:00100000:2.0:1789478656.872550:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945587200 00000100:00100000:2.0:1789478656.872629:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 126 00000100:00100000:2.0:1789478656.872639:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc38e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+10:14890:x1876403945587200:12345-192.168.206.11@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789478656.872812:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc38e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+10:14890:x1876403945587200:12345-192.168.206.11@tcp:503:mount.lustre.0 Request processed in 174us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478656.872820:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 126 00000100:00100000:2.0:1789478656.875782:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478656.876355:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945587328 00000100:00100000:0.0:1789478656.876366:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945587328 00000100:00100000:0.0:1789478656.876451:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 127 00000100:00100000:0.0:1789478656.876462:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc38e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+10:14914:x1876403945587328:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789478656.876633:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc38e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+10:14914:x1876403945587328:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 171us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478656.876641:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 127 00000100:00100000:1.0:1789478656.881681:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478656.882519:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945587456 00000100:00100000:2.0:1789478656.882534:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945587456 00000100:00100000:2.0:1789478656.882585:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 128 00000100:00100000:2.0:1789478656.882964:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+10:14914:x1876403945587456:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789478656.883141:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+10:14914:x1876403945587456:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 546us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478656.883151:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 128 00000100:00100000:1.0:1789478656.895918:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478656.895964:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478656.896069:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945587584 00000100:00100000:3.0:1789478656.896080:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945587584 00000100:00100000:3.0:1789478656.896131:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945587840 00000100:00100000:3.0:1789478656.896133:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945587840 00000100:00100000:3.0:1789478656.896162:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:3.0:1789478656.896170:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2394:x1876403945587584:12345-192.168.206.11@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789478656.896208:0:17238:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from cca3a112-296c-4f03-abf1-9544e970264f@192.168.206.11@tcp t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:3.0:1789478656.896259:0:17238:0:(genops.c:1385:class_connect()) connect: client cca3a112-296c-4f03-abf1-9544e970264f, cookie 0x8ebaae74e82173de 00000004:00100000:3.0:1789478656.896282:0:17238:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789478656.896482:0:17238:0:(import.c:65:import_set_state_nolock()) ffff8ebb0205a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789478656.896541:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+6:2394:x1876403945587584:12345-192.168.206.11@tcp:38:mount.lustre.0 Request processed in 370us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478656.896548:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:3.0:1789478656.896564:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 8 00000100:00100000:3.0:1789478656.896569:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2394:x1876403945587840:12345-192.168.206.11@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789478656.896583:0:17238:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from cca3a112-296c-4f03-abf1-9544e970264f@192.168.206.11@tcp t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:3.0:1789478656.896649:0:17238:0:(genops.c:1385:class_connect()) connect: client cca3a112-296c-4f03-abf1-9544e970264f, cookie 0x8ebaae74e82173e5 00000004:00100000:3.0:1789478656.896661:0:17238:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789478656.896785:0:17238:0:(import.c:65:import_set_state_nolock()) ffff8ebb01bde000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789478656.896810:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+6:2394:x1876403945587840:12345-192.168.206.11@tcp:38:mount.lustre.0 Request processed in 239us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478656.896816:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 8 00000100:00100000:1.0:1789478656.905985:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478656.906024:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478656.906489:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478656.906586:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945588096 00000100:00100000:0.0:1789478656.906633:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945588096 00000100:00100000:0.0:1789478656.906689:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945587968 00000100:00100000:0.0:1789478656.906692:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945587968 00000100:00100000:0.0:1789478656.906705:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945587712 00000100:00100000:0.0:1789478656.906707:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945587712 00000100:00100000:0.0:1789478656.906721:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:0.0:1789478656.906730:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+7:14890:x1876403945588096:12345-192.168.206.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789478656.906766:0:17240:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789478656.906845:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+7:14890:x1876403945588096:12345-192.168.206.11@tcp:41:mount.lustre.0 Request processed in 115us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478656.906852:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:0.0:1789478656.906869:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:0.0:1789478656.906875:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+6:0:x1876403945587968:12345-192.168.206.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789478656.906891:0:17240:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789478656.906926:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+6:0:x1876403945587968:12345-192.168.206.11@tcp:41:mount.lustre.0 Request processed in 51us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478656.906943:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:0.0:1789478656.906954:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 11 00000100:00100000:0.0:1789478656.906959:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+6:0:x1876403945587712:12345-192.168.206.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789478656.906968:0:17240:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789478656.906986:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+6:0:x1876403945587712:12345-192.168.206.11@tcp:41:mount.lustre.0 Request processed in 26us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478656.906991:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 11 00000100:00080000:1.0:1789478656.907714:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789478656.907720:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789478656.911504:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478656.911812:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945588224 00000100:00100000:0.0:1789478656.911820:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945588224 00000100:00100000:0.0:1789478656.911874:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:0.0:1789478656.911883:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+6:14890:x1876403945588224:12345-192.168.206.11@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789478656.911961:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+6:14890:x1876403945588224:12345-192.168.206.11@tcp:40:mount.lustre.0 Request processed in 79us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478656.911969:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:1.0:1789478656.913834:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478656.913870:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478656.913926:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478656.913994:0:17250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945588608 00000100:00100000:3.0:1789478656.914002:0:17250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945588608 00000100:00100000:3.0:1789478656.914060:0:17250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:3.0:1789478656.914068:0:17250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cca3a112-296c-4f03-abf1-9544e970264f+6:14890:x1876403945588608:12345-192.168.206.11@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789478656.914135:0:17250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cca3a112-296c-4f03-abf1-9544e970264f+6:14890:x1876403945588608:12345-192.168.206.11@tcp:900:mount.lustre.0 Request processed in 68us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478656.914141:0:17250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:3.0:1789478656.914159:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945588352 00000100:00100000:3.0:1789478656.914162:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945588352 00000100:00100000:3.0:1789478656.914173:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945588480 00000100:00100000:3.0:1789478656.914175:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945588480 00000100:00100000:3.0:1789478656.914185:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:3.0:1789478656.914190:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2394:x1876403945588352:12345-192.168.206.11@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789478656.914224:0:18748:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from cca3a112-296c-4f03-abf1-9544e970264f@192.168.206.11@tcp t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:3.0:1789478656.914250:0:18748:0:(genops.c:1385:class_connect()) connect: client cca3a112-296c-4f03-abf1-9544e970264f, cookie 0x8ebaae74e82173ec 00002000:00100000:3.0:1789478656.914260:0:18748:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cca3a112-296c-4f03-abf1-9544e970264f/ffff8ebb01bdf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789478656.914275:0:18748:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789478656.914426:0:18748:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789478656.914456:0:18748:0:(import.c:65:import_set_state_nolock()) ffff8ebb01bdb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789478656.914481:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cca3a112-296c-4f03-abf1-9544e970264f+6:2394:x1876403945588352:12345-192.168.206.11@tcp:8:mount.lustre.0 Request processed in 290us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478656.914488:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:3.0:1789478656.914499:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:3.0:1789478656.914503:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2394:x1876403945588480:12345-192.168.206.11@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789478656.914516:0:18748:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from cca3a112-296c-4f03-abf1-9544e970264f@192.168.206.11@tcp t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:3.0:1789478656.914531:0:18748:0:(genops.c:1385:class_connect()) connect: client cca3a112-296c-4f03-abf1-9544e970264f, cookie 0x8ebaae74e82173f3 00002000:00100000:3.0:1789478656.914535:0:18748:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cca3a112-296c-4f03-abf1-9544e970264f/ffff8ebb01bda000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789478656.914550:0:18748:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789478656.914709:0:18748:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789478656.914725:0:18748:0:(import.c:65:import_set_state_nolock()) ffff8ebc3f68d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789478656.914745:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cca3a112-296c-4f03-abf1-9544e970264f+6:2394:x1876403945588480:12345-192.168.206.11@tcp:8:mount.lustre.0 Request processed in 240us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478656.914751:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:3.0:1789478656.920008:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478656.920134:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945588736 00000100:00100000:2.0:1789478656.920160:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945588736 00000100:00100000:2.0:1789478656.920232:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:2.0:1789478656.920243:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cca3a112-296c-4f03-abf1-9544e970264f+6:14890:x1876403945588736:12345-192.168.206.11@tcp:33:mount.lustre.0 00000004:00080000:3.0:1789478656.930521:0:17241:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 10191us 00000004:00200000:2.0:1789478656.948591:0:17241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789478656.948740:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cca3a112-296c-4f03-abf1-9544e970264f+6:14890:x1876403945588736:12345-192.168.206.11@tcp:33:mount.lustre.0 Request processed in 28494us (28735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478656.948751:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:3.0:1789478657.101709:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478657.101774:0:18465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945588864 00000100:00100000:2.0:1789478657.101784:0:18465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945588864 00000100:00100000:2.0:1789478657.101843:0:18465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 13 00000100:00100000:2.0:1789478657.101854:0:18465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca3a112-296c-4f03-abf1-9544e970264f+6:14937:x1876403945588864:12345-192.168.206.11@tcp:101:mkdir.0 00010000:00010000:2.0:1789478657.101873:0:18465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478657.101896:0:18465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e82173fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b76f2 expref: -99 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478657.101955:0:18465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8217401 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478657.101968:0:18465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8217401 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478657.101981:0:18465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8217401 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478657.102209:0:18465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789478657.102213:0:18465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789478657.102253:0:18465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8217401 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478657.102279:0:18465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e82173fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b76f2 expref: 8 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478657.102310:0:18465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8217401 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b76f2 expref: 7 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478657.102318:0:18465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc34e78100) 00010000:00010000:2.0:1789478657.102321:0:18465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789478657.102324:0:18465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4b200, rc 0) 00000100:00100000:2.0:1789478657.102421:0:18465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca3a112-296c-4f03-abf1-9544e970264f+7:14937:x1876403945588864:12345-192.168.206.11@tcp:101:mkdir.0 Request processed in 569us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478657.102428:0:18465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 13 00000100:00100000:2.0:1789478657.254368:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964531328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789478657.254437:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478657.254492:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964531328 00000100:00100000:2.0:1789478657.254498:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964531328 00000100:00100000:2.0:1789478657.254546:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789478657.254555:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964531328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789478657.254574:0:18750:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789478657.254644:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964531328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478657.254651:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789478657.254692:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964531328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789478657.254916:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964531712:0@lo:400:kworker.0 00000100:00100000:0.0:1789478657.254945:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478657.254962:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964532224:0@lo:400:kworker.0 00000100:00100000:0.0:1789478657.254979:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478657.254991:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964532736:0@lo:400:kworker.0 00000100:00100000:0.0:1789478657.255014:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478657.255033:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789478657.255038:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964531840:0@lo:400:kworker.0 00000100:00100000:0.0:1789478657.255058:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478657.255089:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964532352:0@lo:400:kworker.0 00000100:00100000:0.0:1789478657.255124:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478657.255138:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876403964532864:0@lo:400:kworker.0 00000100:00100000:0.0:1789478657.255158:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478657.255184:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964532736 00000100:00100000:0.0:1789478657.255188:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964532736 00000100:00100000:0.0:1789478657.255211:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964531840 00000100:00100000:0.0:1789478657.255214:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964531840 00000100:00100000:0.0:1789478657.255227:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964532352 00000100:00100000:0.0:1789478657.255229:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964532352 00000100:00100000:0.0:1789478657.255238:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964532864 00000100:00100000:0.0:1789478657.255240:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964532864 00000100:00100000:0.0:1789478657.255253:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789478657.255259:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964532736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478657.255298:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876403964532736:12345-0@lo:400:kworker.0 Request processed in 39us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478657.255304:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789478657.255318:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789478657.255324:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964531840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478657.255349:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964531840:12345-0@lo:400:kworker.0 Request processed in 26us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478657.255355:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789478657.255366:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789478657.255372:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964532352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478657.255393:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964532352:12345-0@lo:400:kworker.0 Request processed in 23us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478657.255398:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789478657.255416:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789478657.255421:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876403964532864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478657.255459:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876403964532864:12345-0@lo:400:kworker.0 Request processed in 38us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478657.255465:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789478657.255525:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964531840:0@lo:400:kworker.0 00000100:00100000:0.0:1789478657.255535:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964532352:0@lo:400:kworker.0 00010000:00080000:0.0:1789478657.255546:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc08886d80 x1876403964532864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478657.255554:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876403964532864:0@lo:400:kworker.0 00000100:00100000:0.0:1789478657.255563:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876403964532736:0@lo:400:kworker.0 00000100:00100000:2.0:1789478657.255729:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964531712 00000100:00100000:2.0:1789478657.255734:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964531712 00000100:00100000:2.0:1789478657.255768:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964532224 00000100:00100000:2.0:1789478657.255770:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964532224 00000100:00100000:2.0:1789478657.255790:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789478657.255804:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876403964531712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478657.255842:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876403964531712:12345-0@lo:400:kworker.0 Request processed in 40us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478657.255847:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789478657.255858:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789478657.255863:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964532224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478657.255885:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964532224:12345-0@lo:400:kworker.0 Request processed in 21us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478657.255891:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789478657.256000:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d53a32c3-7c45-4781-893e-f633d5432f2d:3647:1876403964531456:0@lo:400:kworker.0 00000100:00100000:3.0:1789478657.256032:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478657.256069:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964531968:0@lo:400:kworker.0 00000100:00100000:3.0:1789478657.256093:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478657.256120:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964532480:0@lo:400:kworker.0 00000100:00100000:3.0:1789478657.256144:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478657.256160:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb044b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964532992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789478657.256181:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478657.256200:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789478657.256205:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964531584:0@lo:400:kworker.0 00000100:00100000:3.0:1789478657.256226:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478657.256241:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964532096:0@lo:400:kworker.0 00000100:00100000:3.0:1789478657.256260:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478657.256276:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964532608:0@lo:400:kworker.0 00000100:00100000:3.0:1789478657.256298:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478657.256332:0:19341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964532096 00000100:00100000:3.0:1789478657.256336:0:19341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964532096 00000100:00100000:3.0:1789478657.256365:0:19341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789478657.256372:0:19341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964532096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478657.256407:0:19341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964532096:12345-0@lo:400:kworker.0 Request processed in 36us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478657.256413:0:19341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789478657.256428:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964532480 00000100:00100000:3.0:1789478657.256431:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964532480 00000100:00100000:3.0:1789478657.256452:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964532608 00000100:00100000:3.0:1789478657.256455:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964532608 00000100:00100000:3.0:1789478657.256467:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789478657.256473:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964532480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478657.256501:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876403964532480:12345-0@lo:400:kworker.0 Request processed in 28us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478657.256506:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789478657.256516:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789478657.256522:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964532608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478657.256546:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964532608:12345-0@lo:400:kworker.0 Request processed in 24us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478657.256551:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789478657.256569:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964532992 00000100:00100000:3.0:1789478657.256572:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964532992 00000100:00100000:3.0:1789478657.256626:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789478657.256634:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964532992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789478657.256646:0:18750:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789478657.256673:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964532992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478657.256685:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789478657.256725:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964532096:0@lo:400:kworker.0 00010000:00080000:3.0:1789478657.256736:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc08887b80 x1876403964532608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789478657.256744:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964532608:0@lo:400:kworker.0 00000100:00100000:3.0:1789478657.256755:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876403964532480:0@lo:400:kworker.0 00000100:00100000:3.0:1789478657.256767:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb044b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964532992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789478657.256794:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964531968 00000100:00100000:3.0:1789478657.256797:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964531968 00000100:00100000:3.0:1789478657.256813:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964531584 00000100:00100000:3.0:1789478657.256816:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964531584 00000100:00100000:3.0:1789478657.256827:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789478657.256833:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964531968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478657.256866:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964531968:12345-0@lo:400:kworker.0 Request processed in 33us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478657.256872:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789478657.256884:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789478657.256890:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964531584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478657.256918:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964531584:12345-0@lo:400:kworker.0 Request processed in 28us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478657.256923:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789478657.256946:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964531584:0@lo:400:kworker.0 00000100:00100000:3.0:1789478657.256955:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964531968:0@lo:400:kworker.0 00000100:00100000:2.0:1789478657.257109:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964531456 00000100:00100000:2.0:1789478657.257113:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964531456 00000100:00100000:2.0:1789478657.257146:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789478657.257152:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+24:3647:x1876403964531456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478657.257188:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+24:3647:x1876403964531456:12345-0@lo:400:kworker.0 Request processed in 36us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478657.257194:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789478657.257225:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d53a32c3-7c45-4781-893e-f633d5432f2d:3647:1876403964531456:0@lo:400:kworker.0 00000100:00100000:1.0:1789478657.257400:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964533120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789478657.257428:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789478657.257459:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789478657.257473:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789478657.257478:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789478657.257480:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789478657.257482:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789478657.257588:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964531712:0@lo:400:kworker.0 00000100:00100000:0.0:1789478657.257630:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964532224:0@lo:400:kworker.0 00000100:00100000:3.0:1789478657.258376:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964533120 00000100:00100000:3.0:1789478657.258383:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964533120 00000100:00100000:3.0:1789478657.258430:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789478657.258439:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1876403964533120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789478657.258456:0:18750:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789478657.258515:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1876403964533120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478657.258523:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789478657.258643:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964533120:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1789478657.770038:0:18742:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cca3a112-296c-4f03-abf1-9544e970264f 00000001:00100000:0.0:1789478657.770710:0:19559:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cca3a112-296c-4f03-abf1-9544e970264f 00000001:00080000:0.0:1789478657.770724:0:19559:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:0.0:1789478658.276744:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478659.036914:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478659.038247:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945588992 00000100:00100000:3.0:1789478659.038335:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945588992 00000100:00100000:3.0:1789478659.038487:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00100000:3.0:1789478659.038510:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca3a112-296c-4f03-abf1-9544e970264f+7:14990:x1876403945588992:12345-192.168.206.11@tcp:41:lfs.0 00000004:00000024:3.0:1789478659.038547:0:17239:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789478659.038701:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca3a112-296c-4f03-abf1-9544e970264f+7:14990:x1876403945588992:12345-192.168.206.11@tcp:41:lfs.0 Request processed in 194us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478659.038709:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00100000:3.0:1789478659.044377:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478659.045243:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945589120 00000100:00100000:0.0:1789478659.045254:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945589120 00000100:00080000:1.0:1789478659.048125:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789478659.048135:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789478659.052310:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00100000:0.0:1789478659.052327:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+6:14990:x1876403945589120:12345-192.168.206.11@tcp:41:lfs.0 00000004:00000024:0.0:1789478659.052369:0:17240:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789478659.052463:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+6:14990:x1876403945589120:12345-192.168.206.11@tcp:41:lfs.0 Request processed in 141us (8095us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478659.052486:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00100000:2.0:1789478659.055148:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478659.056178:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945589248 00000100:00100000:3.0:1789478659.056189:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945589248 00000100:00080000:1.0:1789478659.056368:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789478659.056439:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:0.0:1789478659.056452:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cca3a112-296c-4f03-abf1-9544e970264f+5:14990:x1876403945589248:12345-192.168.206.11@tcp:13:lfs.0 00002000:00000024:0.0:1789478659.056480:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789478659.056794:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cca3a112-296c-4f03-abf1-9544e970264f+5:14990:x1876403945589248:12345-192.168.206.11@tcp:13:lfs.0 Request processed in 344us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478659.056802:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:2.0:1789478659.059813:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478659.059898:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945589376 00000100:00100000:0.0:1789478659.059907:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945589376 00000100:00100000:0.0:1789478659.059969:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:0.0:1789478659.059980:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cca3a112-296c-4f03-abf1-9544e970264f+5:14990:x1876403945589376:12345-192.168.206.11@tcp:13:lfs.0 00002000:00000024:0.0:1789478659.060081:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789478659.060170:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cca3a112-296c-4f03-abf1-9544e970264f+5:14990:x1876403945589376:12345-192.168.206.11@tcp:13:lfs.0 Request processed in 191us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478659.060177:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00080000:1.0:1789478659.060481:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789478659.251116:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478659.251950:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945589504 00000100:00100000:0.0:1789478659.251961:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945589504 00000100:00100000:0.0:1789478659.252080:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 130 00000100:00100000:0.0:1789478659.252105:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+10:15021:x1876403945589504:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789478659.252122:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478659.252141:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40f05000/0x8ebaae74e8217408 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b76f9 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478659.252169:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40f05000/0x8ebaae74e8217408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b76f9 expref: 11 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478659.252201:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40f05000/0x8ebaae74e8217408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b76f9 expref: 11 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478659.252210:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40f05000, rc 0) 00000100:00100000:0.0:1789478659.252271:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+11:15021:x1876403945589504:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 170us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478659.252278:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 130 00000100:00100000:2.0:1789478659.256858:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478659.256941:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945589632 00000100:00100000:3.0:1789478659.256950:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945589632 00000100:00100000:3.0:1789478659.256998:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 131 00000100:00100000:3.0:1789478659.257008:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+11:15021:x1876403945589632:12345-192.168.206.11@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789478659.257159:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+11:15021:x1876403945589632:12345-192.168.206.11@tcp:501:mount.lustre.0 Request processed in 152us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478659.257166:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 131 00000100:00100000:1.0:1789478659.264855:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478659.264940:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945589760 00000100:00100000:3.0:1789478659.264949:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945589760 00000100:00100000:3.0:1789478659.265004:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 132 00000100:00100000:3.0:1789478659.265014:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+11:15021:x1876403945589760:12345-192.168.206.11@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789478659.265161:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+11:15021:x1876403945589760:12345-192.168.206.11@tcp:503:mount.lustre.0 Request processed in 147us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478659.265169:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 132 00000100:00100000:1.0:1789478659.276994:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478659.277087:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945589888 00000100:00100000:0.0:1789478659.277097:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945589888 00000100:00100000:0.0:1789478659.277150:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 133 00000100:00100000:0.0:1789478659.277160:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+11:15028:x1876403945589888:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789478659.277304:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+11:15028:x1876403945589888:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 145us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478659.277313:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 133 00010000:00010000:3.0:1789478659.300992:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478659.310196:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478659.310841:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945590016 00000100:00100000:2.0:1789478659.310851:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945590016 00000100:00100000:2.0:1789478659.310911:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 134 00000100:00100000:2.0:1789478659.310921:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+11:15028:x1876403945590016:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789478659.311074:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+11:15028:x1876403945590016:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 153us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478659.311086:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 134 00000100:00100000:1.0:1789478659.319507:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478659.319646:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945590144 00000100:00100000:3.0:1789478659.319656:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945590144 00000100:00100000:3.0:1789478659.319713:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 135 00000100:00100000:3.0:1789478659.319777:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+11:15028:x1876403945590144:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789478659.319914:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+11:15028:x1876403945590144:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 191us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478659.319922:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 135 00000100:00100000:1.0:1789478659.324736:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478659.325155:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945590272 00000100:00100000:0.0:1789478659.325164:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945590272 00000100:00100000:0.0:1789478659.325356:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 136 00000100:00100000:0.0:1789478659.325369:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+11:15021:x1876403945590272:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789478659.325385:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478659.325403:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40f05400/0x8ebaae74e821740f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b772a expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478659.325431:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40f05400/0x8ebaae74e821740f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b772a expref: 12 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478659.325478:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40f05400/0x8ebaae74e821740f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b772a expref: 12 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478659.325487:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40f05400, rc 0) 00000100:00100000:0.0:1789478659.325547:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+12:15021:x1876403945590272:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 181us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478659.329681:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 136 00000100:00100000:0.0:1789478659.332494:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478659.332575:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945590400 00000100:00100000:3.0:1789478659.332624:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945590400 00000100:00100000:3.0:1789478659.332691:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 137 00000100:00100000:3.0:1789478659.332701:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc35851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+12:15021:x1876403945590400:12345-192.168.206.11@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789478659.332724:0:17234:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789478659.332757:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789478659.332762:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789478659.332764:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789478659.332767:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789478659.332769:0:17234:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1789478659.339709:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc35851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+12:15021:x1876403945590400:12345-192.168.206.11@tcp:256:mount.lustre.0 Request processed in 6999us (7214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478659.339736:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 137 00000100:00100000:1.0:1789478659.345080:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478659.345266:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945590528 00000100:00100000:0.0:1789478659.345274:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945590528 00000100:00100000:0.0:1789478659.345324:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 138 00000100:00100000:0.0:1789478659.345333:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+12:15021:x1876403945590528:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789478659.345349:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478659.345365:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40f05600/0x8ebaae74e8217416 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7731 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478659.345390:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40f05600/0x8ebaae74e8217416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7731 expref: 13 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478659.345401:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40f05600/0x8ebaae74e8217416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7731 expref: 13 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478659.345410:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40f05600, rc 0) 00000100:00100000:0.0:1789478659.345461:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+13:15021:x1876403945590528:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 128us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478659.345469:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 138 00000100:00100000:1.0:1789478659.360331:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478659.363642:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945590656 00000100:00100000:3.0:1789478659.363658:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945590656 00000100:00100000:3.0:1789478659.363731:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 139 00000100:00100000:3.0:1789478659.363743:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+13:15021:x1876403945590656:12345-192.168.206.11@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789478659.363877:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+13:15021:x1876403945590656:12345-192.168.206.11@tcp:501:mount.lustre.0 Request processed in 135us (3554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478659.363884:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 139 00000100:00100000:1.0:1789478659.377704:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478659.377800:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945590784 00000100:00100000:2.0:1789478659.377809:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945590784 00000100:00100000:2.0:1789478659.377860:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 140 00000100:00100000:2.0:1789478659.377870:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+13:15021:x1876403945590784:12345-192.168.206.11@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789478659.378000:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+13:15021:x1876403945590784:12345-192.168.206.11@tcp:503:mount.lustre.0 Request processed in 130us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478659.378008:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 140 00000100:00100000:1.0:1789478659.381844:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478659.382010:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945590912 00000100:00100000:2.0:1789478659.382019:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945590912 00000100:00100000:2.0:1789478659.382078:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 141 00000100:00100000:2.0:1789478659.382094:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+13:15033:x1876403945590912:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789478659.382239:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+13:15033:x1876403945590912:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 151us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478659.382248:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 141 00000100:00100000:1.0:1789478659.385001:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478659.385095:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945591040 00000100:00100000:3.0:1789478659.385104:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945591040 00000100:00100000:3.0:1789478659.385165:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 142 00000100:00100000:3.0:1789478659.385179:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+13:15033:x1876403945591040:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789478659.385319:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+13:15033:x1876403945591040:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 141us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478659.385327:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 142 00000100:00100000:1.0:1789478659.390302:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478659.390347:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478659.394391:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945591168 00000100:00100000:0.0:1789478659.394405:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945591168 00000100:00100000:0.0:1789478659.394466:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945591424 00000100:00100000:0.0:1789478659.394469:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945591424 00000100:00100000:0.0:1789478659.394500:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:0.0:1789478659.394512:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2394:x1876403945591168:12345-192.168.206.11@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789478659.394539:0:17238:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from d59ee182-687f-47d8-811d-4824d67b8550@192.168.206.11@tcp t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:0.0:1789478659.394577:0:17238:0:(genops.c:1385:class_connect()) connect: client d59ee182-687f-47d8-811d-4824d67b8550, cookie 0x8ebaae74e821741d 00000100:00100000:3.0:1789478659.394627:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:3.0:1789478659.394634:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1876403945591424:12345-192.168.206.11@tcp:38:mount.lustre.0 00000004:00100000:0.0:1789478659.394643:0:17238:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00010000:00080000:3.0:1789478659.394726:0:17239:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from d59ee182-687f-47d8-811d-4824d67b8550@192.168.206.11@tcp t0 exp 0000000000000000 cur 488 last 0 00000100:00080000:0.0:1789478659.394732:0:17238:0:(import.c:65:import_set_state_nolock()) ffff8ebc4120a800 : changing import state from RECOVER to FULL 00000020:00000080:3.0:1789478659.394762:0:17239:0:(genops.c:1385:class_connect()) connect: client d59ee182-687f-47d8-811d-4824d67b8550, cookie 0x8ebaae74e8217424 00000004:00100000:3.0:1789478659.394777:0:17239:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789478659.394798:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d59ee182-687f-47d8-811d-4824d67b8550+6:2394:x1876403945591168:12345-192.168.206.11@tcp:38:mount.lustre.0 Request processed in 285us (4503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478659.394809:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00080000:3.0:1789478659.394847:0:17239:0:(import.c:65:import_set_state_nolock()) ffff8ebc081d5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789478659.394879:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d59ee182-687f-47d8-811d-4824d67b8550+6:2394:x1876403945591424:12345-192.168.206.11@tcp:38:mount.lustre.0 Request processed in 243us (4531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478659.394887:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:1.0:1789478659.402688:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478659.402728:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478659.402764:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478659.406945:0:18465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945591680 00000100:00100000:2.0:1789478659.406959:0:18465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945591680 00000100:00100000:2.0:1789478659.407194:0:18465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945591552 00000100:00100000:2.0:1789478659.407199:0:18465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945591552 00000100:00080000:1.0:1789478659.407228:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789478659.407240:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789478659.407392:0:18465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945591296 00000100:00100000:2.0:1789478659.407396:0:18465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945591296 00000100:00100000:2.0:1789478659.407418:0:18465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:2.0:1789478659.407428:0:18465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d59ee182-687f-47d8-811d-4824d67b8550+7:15021:x1876403945591680:12345-192.168.206.11@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789478659.407745:0:18465:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789478659.407820:0:18465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d59ee182-687f-47d8-811d-4824d67b8550+7:15021:x1876403945591680:12345-192.168.206.11@tcp:41:mount.lustre.0 Request processed in 392us (5140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478659.407843:0:18465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:2.0:1789478659.407862:0:18465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:2.0:1789478659.407869:0:18465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d59ee182-687f-47d8-811d-4824d67b8550+6:0:x1876403945591552:12345-192.168.206.11@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789478659.407881:0:18465:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789478659.407924:0:18465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d59ee182-687f-47d8-811d-4824d67b8550+6:0:x1876403945591552:12345-192.168.206.11@tcp:41:mount.lustre.0 Request processed in 55us (5195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478659.407930:0:18465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:2.0:1789478659.407943:0:18465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:2.0:1789478659.407950:0:18465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d59ee182-687f-47d8-811d-4824d67b8550+6:0:x1876403945591296:12345-192.168.206.11@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789478659.407960:0:18465:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789478659.407980:0:18465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d59ee182-687f-47d8-811d-4824d67b8550+6:0:x1876403945591296:12345-192.168.206.11@tcp:41:mount.lustre.0 Request processed in 32us (5216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478659.407986:0:18465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:0.0:1789478659.411889:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478659.411984:0:18465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945591808 00000100:00100000:2.0:1789478659.411993:0:18465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945591808 00000100:00100000:2.0:1789478659.412052:0:18465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:2.0:1789478659.412062:0:18465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d59ee182-687f-47d8-811d-4824d67b8550+6:15021:x1876403945591808:12345-192.168.206.11@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789478659.412145:0:18465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d59ee182-687f-47d8-811d-4824d67b8550+6:15021:x1876403945591808:12345-192.168.206.11@tcp:40:mount.lustre.0 Request processed in 85us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478659.412153:0:18465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:1.0:1789478659.421561:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478659.421643:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478659.421667:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478659.421739:0:17250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945592192 00000100:00100000:3.0:1789478659.421748:0:17250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945592192 00000100:00100000:3.0:1789478659.421797:0:17250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:3.0:1789478659.421805:0:17250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d59ee182-687f-47d8-811d-4824d67b8550+6:15021:x1876403945592192:12345-192.168.206.11@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789478659.421869:0:17250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d59ee182-687f-47d8-811d-4824d67b8550+6:15021:x1876403945592192:12345-192.168.206.11@tcp:900:mount.lustre.0 Request processed in 65us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478659.421877:0:17250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:0.0:1789478659.421972:0:19341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945591936 00000100:00100000:0.0:1789478659.421976:0:19341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945591936 00000100:00100000:0.0:1789478659.422002:0:19341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945592064 00000100:00100000:0.0:1789478659.422004:0:19341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945592064 00000100:00100000:0.0:1789478659.422021:0:19341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:0.0:1789478659.422027:0:19341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1876403945591936:12345-192.168.206.11@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789478659.422050:0:19341:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d59ee182-687f-47d8-811d-4824d67b8550@192.168.206.11@tcp t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:0.0:1789478659.422078:0:19341:0:(genops.c:1385:class_connect()) connect: client d59ee182-687f-47d8-811d-4824d67b8550, cookie 0x8ebaae74e821742b 00002000:00100000:0.0:1789478659.422089:0:19341:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d59ee182-687f-47d8-811d-4824d67b8550/ffff8ebc4120f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789478659.422099:0:19341:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789478659.422179:0:19341:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789478659.422205:0:19341:0:(import.c:65:import_set_state_nolock()) ffff8ebc4120d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789478659.422250:0:19341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d59ee182-687f-47d8-811d-4824d67b8550+6:2394:x1876403945591936:12345-192.168.206.11@tcp:8:mount.lustre.0 Request processed in 222us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478659.422256:0:19341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:0.0:1789478659.422270:0:19341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:0.0:1789478659.422275:0:19341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1876403945592064:12345-192.168.206.11@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789478659.422291:0:19341:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d59ee182-687f-47d8-811d-4824d67b8550@192.168.206.11@tcp t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:0.0:1789478659.422307:0:19341:0:(genops.c:1385:class_connect()) connect: client d59ee182-687f-47d8-811d-4824d67b8550, cookie 0x8ebaae74e8217432 00002000:00100000:0.0:1789478659.422312:0:19341:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d59ee182-687f-47d8-811d-4824d67b8550/ffff8ebc41208000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789478659.422318:0:19341:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789478659.422358:0:19341:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789478659.422373:0:19341:0:(import.c:65:import_set_state_nolock()) ffff8ebc41209000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789478659.422396:0:19341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d59ee182-687f-47d8-811d-4824d67b8550+6:2394:x1876403945592064:12345-192.168.206.11@tcp:8:mount.lustre.0 Request processed in 119us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478659.422402:0:19341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:3.0:1789478659.424403:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478659.424508:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945592320 00000100:00100000:1.0:1789478659.424517:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945592320 00000100:00100000:1.0:1789478659.424566:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 1 00000100:00100000:1.0:1789478659.424577:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d59ee182-687f-47d8-811d-4824d67b8550+6:15021:x1876403945592320:12345-192.168.206.11@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789478659.424700:0:17242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789478659.424777:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d59ee182-687f-47d8-811d-4824d67b8550+6:15021:x1876403945592320:12345-192.168.206.11@tcp:33:mount.lustre.0 Request processed in 202us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478659.424784:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 1 00000100:00100000:0.0:1789478659.644431:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478659.644569:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945592448 00000100:00100000:3.0:1789478659.644589:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945592448 00000100:00100000:2.0:1789478659.646527:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 22 00000100:00100000:2.0:1789478659.646540:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d59ee182-687f-47d8-811d-4824d67b8550+6:15056:x1876403945592448:12345-192.168.206.11@tcp:101:mkdir.0 00010000:00010000:2.0:1789478659.646572:0:17239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478659.646832:0:17239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8217439 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7762 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478659.646892:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217440 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478659.646904:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217440 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478659.646914:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217440 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478659.646951:0:17239:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789478659.646955:0:17239:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789478659.646971:0:17239:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217440 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478659.646994:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e8217439 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7762 expref: 8 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478659.647010:0:17239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217440 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7762 expref: 7 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478659.647018:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc34e78100) 00010000:00010000:2.0:1789478659.647021:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789478659.647023:0:17239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4aa00, rc 0) 00000100:00100000:2.0:1789478659.647087:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d59ee182-687f-47d8-811d-4824d67b8550+7:15056:x1876403945592448:12345-192.168.206.11@tcp:101:mkdir.0 Request processed in 550us (2666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478659.647101:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 22 00000040:00080000:2.0:1789478659.751745:0:17274:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789478660.330419:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478660.854341:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789478660.854366:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb044b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964533248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789478660.854424:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478660.854483:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964533248 00000100:00100000:3.0:1789478660.854501:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964533248 00000100:00100000:3.0:1789478660.854554:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789478660.854564:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964533248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789478660.854615:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789478660.854660:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964533248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478660.854667:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789478660.854711:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb044b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964533248:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789478660.855700:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789478661.350032:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789478661.350054:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb044b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964533376:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789478661.350115:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789478661.350375:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478661.350678:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964533376 00000100:00100000:0.0:1789478661.350686:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964533376 00000100:00100000:0.0:1789478661.350737:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789478661.350746:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964533376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789478661.350778:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789478661.350852:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964533376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478661.350860:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789478661.351107:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb044b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964533376:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789478661.861328:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964533504:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789478661.861390:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478661.861583:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964533504 00000100:00100000:2.0:1789478661.861632:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964533504 00000100:00100000:2.0:1789478661.861690:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789478661.861700:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964533504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789478661.861732:0:17243:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789478661.861776:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964533504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478661.861784:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789478661.862035:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964533504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789478662.372910:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964534016:0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.372974:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478662.373028:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964534528:0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.373052:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478662.373069:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876403964535040:0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.373092:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478662.373113:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789478662.373119:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d53a32c3-7c45-4781-893e-f633d5432f2d:3647:1876403964533632:0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.373144:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478662.373170:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964534144:0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.373190:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478662.373208:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964534656:0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.373226:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478662.373242:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964535168:0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.373278:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478662.373304:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964533760:0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.373329:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478662.373345:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964534272:0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.373364:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478662.373381:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964534784:0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.373400:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478662.373412:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789478662.373417:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964533888:0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.373436:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478662.373451:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964534400:0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.373468:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478662.373512:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964534912:0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.373532:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789478662.373553:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478662.373565:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964534016 00000100:00100000:0.0:1789478662.373583:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964534016 00000100:00100000:0.0:1789478662.373655:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964534528 00000100:00100000:0.0:1789478662.373658:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964534528 00000100:00100000:0.0:1789478662.373674:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964533888 00000100:00100000:0.0:1789478662.373676:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964533888 00000100:00100000:0.0:1789478662.373689:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964534400 00000100:00100000:0.0:1789478662.373692:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964534400 00000100:00100000:0.0:1789478662.373707:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789478662.373715:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964534016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.373764:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964534016:12345-0@lo:400:kworker.0 Request processed in 49us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478662.373771:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789478662.373789:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789478662.373795:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964534528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.373821:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964534528:12345-0@lo:400:kworker.0 Request processed in 27us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478662.373827:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789478662.373839:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789478662.373844:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964533888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.373874:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964533888:12345-0@lo:400:kworker.0 Request processed in 30us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478662.373880:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789478662.373891:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789478662.373897:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964534400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.373934:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964534400:12345-0@lo:400:kworker.0 Request processed in 37us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478662.373940:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789478662.373965:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964533632 00000100:00100000:0.0:1789478662.373968:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964533632 00000100:00100000:0.0:1789478662.373995:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789478662.374002:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+24:3647:x1876403964533632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.374030:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+24:3647:x1876403964533632:12345-0@lo:400:kworker.0 Request processed in 29us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478662.374036:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789478662.374062:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964535040 00000100:00100000:0.0:1789478662.374066:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964535040 00000100:00100000:0.0:1789478662.374084:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964534144 00000100:00100000:0.0:1789478662.374087:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964534144 00000100:00100000:0.0:1789478662.374097:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964534656 00000100:00100000:0.0:1789478662.374099:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964534656 00000100:00100000:0.0:1789478662.374107:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964535168 00000100:00100000:0.0:1789478662.374109:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964535168 00000100:00100000:0.0:1789478662.374119:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964534784 00000100:00100000:0.0:1789478662.374121:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964534784 00000100:00100000:0.0:1789478662.374132:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964534912 00000100:00100000:0.0:1789478662.374135:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964534912 00000100:00100000:0.0:1789478662.374146:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789478662.374152:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876403964535040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.374179:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876403964535040:12345-0@lo:400:kworker.0 Request processed in 27us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478662.374185:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789478662.374196:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789478662.374202:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964534144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.374236:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876403964534144:12345-0@lo:400:kworker.0 Request processed in 34us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478662.374242:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789478662.374254:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789478662.374259:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964534656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.374284:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876403964534656:12345-0@lo:400:kworker.0 Request processed in 25us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478662.374290:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789478662.374300:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789478662.374306:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964535168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.374333:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876403964535168:12345-0@lo:400:kworker.0 Request processed in 28us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478662.374339:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789478662.374350:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789478662.374356:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964534784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.374381:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964534784:12345-0@lo:400:kworker.0 Request processed in 26us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478662.374386:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789478662.374396:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789478662.374403:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964534912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.374426:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876403964534912:12345-0@lo:400:kworker.0 Request processed in 25us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478662.374432:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789478662.374453:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964533760 00000100:00100000:0.0:1789478662.374457:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964533760 00000100:00100000:0.0:1789478662.374480:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964534272 00000100:00100000:0.0:1789478662.374483:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964534272 00000100:00100000:0.0:1789478662.374492:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789478662.374496:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964533760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.374523:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964533760:12345-0@lo:400:kworker.0 Request processed in 27us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478662.374528:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789478662.374537:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789478662.374542:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964534272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.374561:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964534272:12345-0@lo:400:kworker.0 Request processed in 19us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478662.374578:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1789478662.374689:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789478662.374693:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789478662.374696:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789478662.374697:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789478662.374729:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964533888:0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.374739:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964534400:0@lo:400:kworker.0 00010000:00080000:0.0:1789478662.374750:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03f54000 x1876403964534912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478662.374760:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876403964534912:0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.374769:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964533760:0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.374777:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964534272:0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.374786:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964534784:0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.374832:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d53a32c3-7c45-4781-893e-f633d5432f2d:3647:1876403964533632:0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.374842:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876403964534144:0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.374852:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876403964534656:0@lo:400:kworker.0 00010000:00080000:0.0:1789478662.374862:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03f56a00 x1876403964535168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789478662.374871:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876403964535168:0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.374880:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1789478662.374889:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964534016:0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.374900:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964534528:0@lo:400:kworker.0 00000100:00100000:0.0:1789478662.374910:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876403964535040:0@lo:400:kworker.0 00000100:00100000:2.0:1789478662.375394:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789478662.375406:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964535296:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789478662.375442:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478662.375474:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964535296 00000100:00100000:2.0:1789478662.375478:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964535296 00000100:00100000:2.0:1789478662.375509:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789478662.375517:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964535296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789478662.375543:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789478662.375585:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964535296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478662.375611:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789478662.375643:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964535296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789478662.375875:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789478662.375884:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964535424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789478662.375908:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478662.376834:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964535424 00000100:00100000:3.0:1789478662.376842:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964535424 00000100:00100000:3.0:1789478662.376884:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789478662.376892:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964535424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789478662.376913:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789478662.376963:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964535424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478662.376969:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789478662.377019:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964535424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789478662.378409:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964535552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789478662.378454:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478662.378552:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964535552 00000100:00100000:2.0:1789478662.378559:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964535552 00000100:00100000:2.0:1789478662.378625:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789478662.378633:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964535552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789478662.378649:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789478662.378690:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964535552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478662.378702:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789478662.378781:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964535552:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1789478662.432124:0:20115:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:1.0:1789478662.566559:0:17992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:0.0:1789478662.892023:0:17971:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d59ee182-687f-47d8-811d-4824d67b8550 00000001:00100000:0.0:1789478662.892035:0:17971:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of cca3a112-296c-4f03-abf1-9544e970264f 00000001:00100000:2.0:1789478662.892462:0:17219:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d59ee182-687f-47d8-811d-4824d67b8550 00000001:00100000:2.0:1789478662.892469:0:17219:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cca3a112-296c-4f03-abf1-9544e970264f 00010000:00010000:2.0:1789478663.399551:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478664.420955:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789478664.845793:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478664.845841:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478664.845867:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478664.845888:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478664.845907:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478664.845924:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478664.845943:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478664.845961:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478664.845985:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478664.846010:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945592576 00000100:00100000:3.0:1789478664.846018:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945592576 00000100:00100000:3.0:1789478664.846078:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 144 00000100:00100000:3.0:1789478664.846088:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+13:2396:x1876403945592576:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478664.846226:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+13:2396:x1876403945592576:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 138us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478664.846234:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 144 00000100:00100000:3.0:1789478664.846266:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945592704 00000100:00100000:3.0:1789478664.846270:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945592704 00000100:00100000:3.0:1789478664.846299:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945592832 00000100:00100000:3.0:1789478664.846302:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945592832 00000100:00100000:3.0:1789478664.846313:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945593344 00000100:00100000:3.0:1789478664.846316:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945593344 00000100:00100000:3.0:1789478664.846328:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945593216 00000100:00100000:3.0:1789478664.846330:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945593216 00000100:00100000:3.0:1789478664.846343:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 40 00000100:00100000:3.0:1789478664.846350:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+6:2395:x1876403945592704:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478664.846379:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+6:2395:x1876403945592704:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 30us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478664.846385:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 40 00000100:00100000:3.0:1789478664.846398:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 41 00000100:00100000:3.0:1789478664.846404:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+5:2396:x1876403945592832:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478664.846426:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+5:2396:x1876403945592832:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 22us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478664.846433:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 41 00000100:00100000:3.0:1789478664.846444:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 42 00000100:00100000:3.0:1789478664.846450:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d59ee182-687f-47d8-811d-4824d67b8550+5:2396:x1876403945593344:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478664.846470:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d59ee182-687f-47d8-811d-4824d67b8550+5:2396:x1876403945593344:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 21us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478664.846483:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 42 00000100:00100000:3.0:1789478664.846496:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 43 00000100:00100000:3.0:1789478664.846502:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d59ee182-687f-47d8-811d-4824d67b8550+6:2395:x1876403945593216:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478664.846526:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d59ee182-687f-47d8-811d-4824d67b8550+6:2395:x1876403945593216:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 25us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478664.846532:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 43 00000100:00100000:3.0:1789478664.846551:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945593088 00000100:00100000:3.0:1789478664.846568:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945593088 00000100:00100000:3.0:1789478664.846614:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945593600 00000100:00100000:3.0:1789478664.846618:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945593600 00000100:00100000:3.0:1789478664.846632:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945592960 00000100:00100000:3.0:1789478664.846634:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945592960 00000100:00100000:3.0:1789478664.846644:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945593472 00000100:00100000:3.0:1789478664.846647:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945593472 00000100:00100000:3.0:1789478664.846659:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:3.0:1789478664.846665:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cca3a112-296c-4f03-abf1-9544e970264f+5:2396:x1876403945593088:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478664.846690:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cca3a112-296c-4f03-abf1-9544e970264f+5:2396:x1876403945593088:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 24us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478664.846696:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:3.0:1789478664.846708:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:3.0:1789478664.846714:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d59ee182-687f-47d8-811d-4824d67b8550+6:2396:x1876403945593600:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478664.846736:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d59ee182-687f-47d8-811d-4824d67b8550+6:2396:x1876403945593600:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 22us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478664.846742:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:3.0:1789478664.846753:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 11 00000100:00100000:3.0:1789478664.846766:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cca3a112-296c-4f03-abf1-9544e970264f+5:2395:x1876403945592960:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478664.846791:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cca3a112-296c-4f03-abf1-9544e970264f+5:2395:x1876403945592960:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 26us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478664.846797:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 11 00000100:00100000:3.0:1789478664.846809:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:3.0:1789478664.846815:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d59ee182-687f-47d8-811d-4824d67b8550+6:2395:x1876403945593472:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478664.846834:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d59ee182-687f-47d8-811d-4824d67b8550+6:2395:x1876403945593472:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 18us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478664.846840:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00080000:3.0:1789478664.846999:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789478664.847003:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789478664.847005:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789478664.847006:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1789478664.943458:0:19559:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d59ee182-687f-47d8-811d-4824d67b8550 00000001:00100000:1.0:1789478664.952971:0:18742:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d59ee182-687f-47d8-811d-4824d67b8550 00010000:00010000:0.0:1789478665.445001:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789478665.647060:0:20262:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe30835e30 20000000:00000080:3.0:1789478665.647076:0:20262:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ebc34c88400 uarg=0000000000000000 20000000:01000000:3.0:1789478665.647114:0:20262:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789478665.647119:0:20262:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789478665.647123:0:20262:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789478665.650234:0:20263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1789478665.650399:0:20262:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789478665.665504:0:20262:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789478665.665530:0:20262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8217447 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478665.665548:0:20262:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebb035fda00/0x8ebaae74e82170dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e82170d5 expref: 23 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478665.665568:0:20262:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebb035fd200/0x8ebaae74e82170ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e82170e3 expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478665.665576:0:20262:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc08c4ae00/0x8ebaae74e8217129 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8217122 expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478665.665584:0:20262:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc08c4a600/0x8ebaae74e82171c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e82171bc expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478665.665616:0:20262:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82173d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b76c1 expref: 12 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478665.665625:0:20262:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ebc40f05600/0x8ebaae74e8217416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7731 expref: 12 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478665.665633:0:20262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8217447 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478665.665689:0:20262:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc40f05600/0x8ebaae74e8217416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7731 expref: 12 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478665.665703:0:20262:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ebc40f05600/0x8ebaae74e8217416 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7731 expref: 12 pid: 17233 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478665.665719:0:20262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09124a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20262:1876403964535680:192.168.206.11@tcp:104: 00010000:00010000:2.0:1789478665.665806:0:20262:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82173d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b76c1 expref: 12 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478665.665815:0:20262:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82173d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b76c1 expref: 12 pid: 17234 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478665.665824:0:20262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09125f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20262:1876403964535808:192.168.206.11@tcp:104: 00010000:00010000:2.0:1789478665.668711:0:20262:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc08c4a600/0x8ebaae74e82171c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e82171bc expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478665.668728:0:20262:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ebc08c4a600/0x8ebaae74e82171c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e82171bc expref: 23 pid: 17234 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478665.668742:0:20262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09127b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20262:1876403964535936:0@lo:104: 00000100:00100000:3.0:1789478665.670215:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478665.670297:0:20262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789478665.670354:0:20262:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebc08c4ae00/0x8ebaae74e8217129 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e8217122 expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478665.670369:0:20262:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ebc08c4ae00/0x8ebaae74e8217129 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e8217122 expref: 23 pid: 17234 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478665.670399:0:20262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09124380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20262:1876403964536064:0@lo:104: 00000100:00100000:0.0:1789478665.670439:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945593728 00000100:00100000:0.0:1789478665.670447:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945593728 00010000:00010000:0.0:1789478665.670475:0:17225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc40f05600/0x8ebaae74e8217416 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7731 expref: 13 pid: 17233 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478665.670506:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:0.0:1789478665.670516:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04485500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+13:2395:x1876403945593728:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478665.670536:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478665.670542:0:17225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc40f05600/0x8ebaae74e8217416 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7731 expref: 13 pid: 17233 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478665.670566:0:17225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc40f05600/0x8ebaae74e8217416 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7731 expref: 13 pid: 17233 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478665.670584:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478665.670731:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04485500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+13:2395:x1876403945593728:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 216us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478665.670739:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:2.0:1789478665.670819:0:20262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789478665.670867:0:20262:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebb035fd200/0x8ebaae74e82170ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e82170e3 expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478665.670878:0:20262:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ebb035fd200/0x8ebaae74e82170ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e82170e3 expref: 23 pid: 17234 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478665.670887:0:20262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09124000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20262:1876403964536192:0@lo:104: 00000100:00100000:2.0:1789478665.670913:0:20262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789478665.670936:0:20262:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ebb035fda00/0x8ebaae74e82170dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ebaae74e82170d5 expref: 23 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478665.670941:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964535936 00010000:00010000:2.0:1789478665.670946:0:20262:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ebb035fda00/0x8ebaae74e82170dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ebaae74e82170d5 expref: 23 pid: 17233 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478665.670947:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964535936 00000100:00100000:2.0:1789478665.670959:0:20262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20262:1876403964536320:0@lo:104: 00000100:00100000:1.0:1789478665.670972:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964536064 00000100:00100000:1.0:1789478665.670977:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964536064 00000100:00100000:2.0:1789478665.670986:0:20262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478665.670994:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964536192 00000100:00100000:1.0:1789478665.670998:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964536192 00000100:00100000:2.0:1789478665.671000:0:20262:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc3c8a6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789478665.671012:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964536320 00000100:00100000:1.0:1789478665.671016:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964536320 00010000:00010000:2.0:1789478665.671026:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc40f05600/0x8ebaae74e8217416 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7731 expref: 12 pid: 17233 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478665.671030:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789478665.671041:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09124700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d53a32c3-7c45-4781-893e-f633d5432f2d+6:20262:x1876403964535936:12345-0@lo:104: 00000100:00100000:2.0:1789478665.671047:0:20262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09124a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20262:1876403964535680:192.168.206.11@tcp:104: 00010000:00010000:1.0:1789478665.671059:0:17222:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e82171bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e82171c3 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.671126:0:17222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789478665.671132:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09124700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d53a32c3-7c45-4781-893e-f633d5432f2d+6:20262:x1876403964535936:12345-0@lo:104: Request processed in 93us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478665.671138:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789478665.671443:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789478665.671453:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09127800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d53a32c3-7c45-4781-893e-f633d5432f2d+5:20262:x1876403964536064:12345-0@lo:104: 00010000:00010000:1.0:1789478665.671461:0:17222:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ac00/0x8ebaae74e8217122 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8217129 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.671495:0:17222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789478665.671500:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09127800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d53a32c3-7c45-4781-893e-f633d5432f2d+5:20262:x1876403964536064:12345-0@lo:104: Request processed in 51us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478665.671506:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789478665.671520:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789478665.671525:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09125180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d53a32c3-7c45-4781-893e-f633d5432f2d+4:20262:x1876403964536192:12345-0@lo:104: 00010000:00010000:1.0:1789478665.671542:0:17222:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e82170e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e82170ea expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.671587:0:17222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789478665.671614:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09125180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d53a32c3-7c45-4781-893e-f633d5432f2d+4:20262:x1876403964536192:12345-0@lo:104: Request processed in 68us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478665.671620:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789478665.671633:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789478665.671639:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03598380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d53a32c3-7c45-4781-893e-f633d5432f2d+3:20262:x1876403964536320:12345-0@lo:104: 00010000:00010000:1.0:1789478665.671647:0:17222:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc800/0x8ebaae74e82170d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e82170dc expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.671675:0:17222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789478665.671680:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03598380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d53a32c3-7c45-4781-893e-f633d5432f2d+3:20262:x1876403964536320:12345-0@lo:104: Request processed in 42us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478665.671753:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789478665.671782:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789478665.671788:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e82171bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e82171c3 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.671795:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc34f77800 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:1.0:1789478665.671799:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e82171bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e82171c3 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.671808:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e82171bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e82171c3 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478665.671815:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e82171bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e82171c3 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478665.671827:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789478665.671855:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e82171bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e82171c3 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.671862:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789478665.671880:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e82171bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e82171c3 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.671887:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc34f77800/0x8ebaae74e82171bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e82171c3 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.671898:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789478665.671901:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ac00/0x8ebaae74e8217122 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e8217129 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.671906:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4ac00 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:1.0:1789478665.671909:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ac00/0x8ebaae74e8217122 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e8217129 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.671914:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ac00/0x8ebaae74e8217122 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e8217129 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478665.671920:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ac00/0x8ebaae74e8217122 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e8217129 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478665.671924:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789478665.671936:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ac00/0x8ebaae74e8217122 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8217129 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.671942:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789478665.671965:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ac00/0x8ebaae74e8217122 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8217129 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.671972:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebc08c4ac00/0x8ebaae74e8217122 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e8217129 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.671982:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789478665.671985:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e82170e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e82170ea expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.671991:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fd800 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:1.0:1789478665.671994:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e82170e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e82170ea expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.672000:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e82170e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e82170ea expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478665.672007:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e82170e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e82170ea expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478665.672012:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789478665.672025:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e82170e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e82170ea expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.672031:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789478665.672036:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e82170e3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e82170ea expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.672041:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebb035fd800/0x8ebaae74e82170e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e82170ea expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.672072:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789478665.672075:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc800/0x8ebaae74e82170d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ebaae74e82170dc expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.672080:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebb035fc800 already unused, calling callback (ffffffffc1383c20) 10000000:00010000:1.0:1789478665.672083:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc800/0x8ebaae74e82170d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ebaae74e82170dc expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.672089:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc800/0x8ebaae74e82170d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ebaae74e82170dc expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789478665.672095:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc800/0x8ebaae74e82170d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ebaae74e82170dc expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789478665.672100:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789478665.672124:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc800/0x8ebaae74e82170d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e82170dc expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.672131:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789478665.672137:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc800/0x8ebaae74e82170d5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e82170dc expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.672143:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff8ebb035fc800/0x8ebaae74e82170d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ebaae74e82170dc expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.672396:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478665.672399:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478665.672400:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478665.672409:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478665.672420:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478665.672439:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d53a32c3-7c45-4781-893e-f633d5432f2d:3648:1876403964536448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789478665.672474:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478665.672503:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789478665.672511:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d53a32c3-7c45-4781-893e-f633d5432f2d:3648:1876403964536832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789478665.672539:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478665.672544:0:20262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09127b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20262:1876403964535936:0@lo:104: 00000100:00100000:2.0:1789478665.672572:0:20262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09124380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20262:1876403964536064:0@lo:104: 00000100:00100000:2.0:1789478665.672585:0:20262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09124000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20262:1876403964536192:0@lo:104: 00000100:00100000:1.0:1789478665.672590:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d53a32c3-7c45-4781-893e-f633d5432f2d:3645:1876403964536576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789478665.672615:0:20262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20262:1876403964536320:0@lo:104: 00000100:00100000:1.0:1789478665.672637:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478665.672673:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789478665.672679:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03e9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d53a32c3-7c45-4781-893e-f633d5432f2d:3645:1876403964536704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789478665.672861:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478665.672899:0:17991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964536448 00000100:00100000:1.0:1789478665.672904:0:17991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964536448 00010000:00010000:1.0:1789478665.672927:0:17991:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc08c4a600/0x8ebaae74e82171c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e82171bc expref: 24 pid: 17234 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478665.672943:0:17991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964536832 00000100:00100000:1.0:1789478665.672946:0:17991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964536832 00010000:00010000:1.0:1789478665.672955:0:17991:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebb035fda00/0x8ebaae74e82170dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e82170d5 expref: 25 pid: 17233 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478665.672963:0:17991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964536576 00000100:00100000:1.0:1789478665.672965:0:17991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964536576 00010000:00010000:1.0:1789478665.672973:0:17991:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc08c4ae00/0x8ebaae74e8217129 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8217122 expref: 26 pid: 17234 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478665.672982:0:17991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964536704 00000100:00100000:1.0:1789478665.672985:0:17991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964536704 00010000:00010000:1.0:1789478665.672993:0:17991:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebb035fd200/0x8ebaae74e82170ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e82170e3 expref: 27 pid: 17234 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478665.673019:0:17991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789478665.673026:0:17991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c960000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d53a32c3-7c45-4781-893e-f633d5432f2d+27:3648:x1876403964536448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789478665.673035:0:17991:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478665.673040:0:17991:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc08c4a600/0x8ebaae74e82171c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e82171bc expref: 27 pid: 17234 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.673048:0:17991:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc08c4a600/0x8ebaae74e82171c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e82171bc expref: 27 pid: 17234 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.673379:0:17991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc08c4a600/0x8ebaae74e82171c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e82171bc expref: 27 pid: 17234 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.673392:0:17991:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478665.673475:0:17991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c960000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d53a32c3-7c45-4781-893e-f633d5432f2d+26:3648:x1876403964536448:12345-0@lo:103:ldlm_bl.0 Request processed in 448us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478665.673483:0:17991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789478665.673501:0:17991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789478665.673508:0:17991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c962680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d53a32c3-7c45-4781-893e-f633d5432f2d+25:3648:x1876403964536832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789478665.673516:0:17991:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478665.673521:0:17991:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebb035fda00/0x8ebaae74e82170dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e82170d5 expref: 25 pid: 17233 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.673530:0:17991:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebb035fda00/0x8ebaae74e82170dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e82170d5 expref: 25 pid: 17233 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.673540:0:17991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebb035fda00/0x8ebaae74e82170dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e82170d5 expref: 25 pid: 17233 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.673573:0:17991:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478665.673616:0:17991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c962680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d53a32c3-7c45-4781-893e-f633d5432f2d+24:3648:x1876403964536832:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478665.673622:0:17991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789478665.673635:0:17991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789478665.673640:0:17991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c960700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d53a32c3-7c45-4781-893e-f633d5432f2d+23:3645:x1876403964536576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789478665.673648:0:17991:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478665.673652:0:17991:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc08c4ae00/0x8ebaae74e8217129 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e8217122 expref: 23 pid: 17234 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.673660:0:17991:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc08c4ae00/0x8ebaae74e8217129 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e8217122 expref: 23 pid: 17234 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.673669:0:17991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc08c4ae00/0x8ebaae74e8217129 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e8217122 expref: 23 pid: 17234 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.673677:0:17991:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478665.673787:0:17991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c960700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d53a32c3-7c45-4781-893e-f633d5432f2d+22:3645:x1876403964536576:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478665.673793:0:17991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789478665.673806:0:17991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789478665.673812:0:17991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3d62b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d53a32c3-7c45-4781-893e-f633d5432f2d+21:3645:x1876403964536704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789478665.673821:0:17991:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478665.673826:0:17991:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebb035fd200/0x8ebaae74e82170ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ebaae74e82170e3 expref: 21 pid: 17234 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.673833:0:17991:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebb035fd200/0x8ebaae74e82170ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ebaae74e82170e3 expref: 21 pid: 17234 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.673849:0:17991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebb035fd200/0x8ebaae74e82170ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ebaae74e82170e3 expref: 21 pid: 17234 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.673858:0:17991:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478665.673880:0:17991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3d62b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d53a32c3-7c45-4781-893e-f633d5432f2d+20:3645:x1876403964536704:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478665.673886:0:17991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789478665.673944:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d53a32c3-7c45-4781-893e-f633d5432f2d:3645:1876403964536704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789478665.673953:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d53a32c3-7c45-4781-893e-f633d5432f2d:3645:1876403964536576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789478665.674526:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d53a32c3-7c45-4781-893e-f633d5432f2d:3648:1876403964536448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789478665.674628:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03e98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d53a32c3-7c45-4781-893e-f633d5432f2d:3648:1876403964536832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789478665.676956:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478665.678675:0:17991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945593856 00000100:00100000:1.0:1789478665.678688:0:17991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945593856 00010000:00010000:1.0:1789478665.678733:0:17991:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82173d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b76c1 expref: 12 pid: 17234 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478665.678774:0:17991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00100000:1.0:1789478665.678783:0:17991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+12:2395:x1876403945593856:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789478665.678795:0:17991:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478665.678801:0:17991:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82173d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b76c1 expref: 12 pid: 17234 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.678813:0:17991:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82173d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b76c1 expref: 12 pid: 17234 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.678831:0:17991:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8217447 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.678839:0:17991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8217447 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.678866:0:17991:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8217447 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.678873:0:17991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8217447 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.678879:0:17991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8217447 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.678886:0:17991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8217447 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.678891:0:17991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4b600 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:1.0:1789478665.678896:0:17991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8217447 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.678904:0:17991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8217447 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.678913:0:17991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8217447 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478665.678923:0:17991:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478665.678967:0:17991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+12:2395:x1876403945593856:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 186us (2020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478665.678975:0:17991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 14 00010000:00010000:2.0:1789478665.679348:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc40f05a00/0x8ebaae74e82173d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b76c1 expref: 11 pid: 17234 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478665.679364:0:20262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09125f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20262:1876403964535808:192.168.206.11@tcp:104: 00010000:00010000:2.0:1789478665.679403:0:20262:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8217447 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478665.679412:0:20262:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8217447 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478665.679417:0:20262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8217447 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478665.679423:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ebc08c4b600/0x8ebaae74e8217447 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478665.957852:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789478665.957879:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964536960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789478665.957941:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478665.958047:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964536960 00000100:00100000:2.0:1789478665.958055:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964536960 00000100:00100000:2.0:1789478665.958114:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789478665.958125:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964536960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789478665.958150:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789478665.958197:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964536960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478665.958204:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789478665.958243:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964536960:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789478665.958362:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789478666.469438:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789478666.469459:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964537088:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789478666.469525:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789478666.469638:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478666.469694:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964537088 00000100:00100000:0.0:1789478666.469703:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964537088 00000100:00100000:0.0:1789478666.469753:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789478666.469762:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964537088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789478666.469793:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789478666.469837:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964537088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478666.469844:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789478666.469962:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964537088:0@lo:41:osp-pre-0-1.0 10000000:01000000:1.0:1789478666.981707:0:17236:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789478666.981715:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebb01b7d000 from 13 10000000:01000000:1.0:1789478666.981720:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789478666.981767:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf000/0x8ebaae74e821744e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478666.981779:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf000/0x8ebaae74e821744e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478666.981792:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf000/0x8ebaae74e821744e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478666.981820:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c962680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964537216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789478666.981899:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478666.981942:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40dfcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789478666.982000:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964537216 00000100:00100000:0.0:1789478666.982007:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964537216 00000100:00100000:0.0:1789478666.982069:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789478666.982078:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+20:17236:x1876403964537216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789478666.982090:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478666.982116:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40f04400/0x8ebaae74e8217455 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e821744e expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478666.982138:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40f04400/0x8ebaae74e8217455 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e821744e expref: 21 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478666.982149:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40f04400/0x8ebaae74e8217455 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e821744e expref: 21 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478666.982158:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40f04400, rc 0) 00000100:00100000:0.0:1789478666.982196:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+21:17236:x1876403964537216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478666.982203:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789478666.982420:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c962680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964537216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789478666.982434:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf000/0x8ebaae74e821744e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217455 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478666.982442:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf000/0x8ebaae74e821744e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8217455 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478666.982499:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c962680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964537344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478666.982525:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478666.982559:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40dfcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789478666.982673:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964537344 00000100:00100000:0.0:1789478666.982678:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964537344 00000100:00100000:0.0:1789478666.982718:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789478666.982724:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+21:17236:x1876403964537344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789478666.982825:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+21:17236:x1876403964537344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478666.982831:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789478666.983061:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c962680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964537344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478666.983091:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c962680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964537472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789478666.983131:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478666.983165:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40dfcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789478666.983259:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964537472 00000100:00100000:0.0:1789478666.983264:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964537472 00000100:00100000:0.0:1789478666.983293:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789478666.983300:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+21:17236:x1876403964537472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789478666.983374:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+21:17236:x1876403964537472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478666.983381:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789478666.983579:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c962680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964537472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789478666.984770:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964537600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789478666.984828:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478666.984924:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964537600 00000100:00100000:2.0:1789478666.984930:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964537600 00000100:00100000:2.0:1789478666.984973:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789478666.985000:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964537600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789478666.985040:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789478666.985090:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876403964537600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478666.985097:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789478666.985170:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876403964537600:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1789478666.985494:0:20330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789478666.985725:0:17236:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789478666.985747:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789478666.985757:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf000/0x8ebaae74e821744e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217455 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478666.985767:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc40fcf000/0x8ebaae74e821744e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217455 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478666.985777:0:17236:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789478666.985780:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebc35e74800 from 13 10000000:01000000:0.0:1789478666.985782:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789478666.985807:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40f05e00/0x8ebaae74e821745c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478666.985814:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc40f05e00/0x8ebaae74e821745c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478666.985824:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc40f05e00/0x8ebaae74e821745c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478666.985841:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964537728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789478666.985876:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478666.986057:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc0636df00 going to sleep for 11 seconds 00000100:00100000:1.0:1789478666.986351:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964537728 00000100:00100000:1.0:1789478666.986358:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964537728 00000100:00100000:1.0:1789478666.986505:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789478666.986515:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+21:17236:x1876403964537728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789478666.986527:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478666.986539:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40fcec00/0x8ebaae74e8217463 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e821745c expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478666.986571:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40fcec00/0x8ebaae74e8217463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e821745c expref: 22 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478666.986581:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40fcec00/0x8ebaae74e8217463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e821745c expref: 22 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478666.986589:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcec00, rc 0) 00000100:00100000:1.0:1789478666.986677:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d53a32c3-7c45-4781-893e-f633d5432f2d+22:17236:x1876403964537728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478666.986694:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789478666.986875:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964537728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789478666.986890:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc40f05e00/0x8ebaae74e821745c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217463 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478666.986899:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc40f05e00/0x8ebaae74e821745c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8217463 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478666.986956:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964537856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789478666.986996:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478666.987197:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc3c8a6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789478666.987229:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964537856 00000100:00100000:0.0:1789478666.987234:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964537856 00000100:00100000:0.0:1789478666.987258:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789478666.987265:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+22:17236:x1876403964537856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789478666.987383:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+22:17236:x1876403964537856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478666.987391:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789478666.987553:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964537856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789478666.987580:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964537984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789478666.987636:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478666.987655:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc3c8a6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789478666.987708:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964537984 00000100:00100000:0.0:1789478666.987712:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964537984 00000100:00100000:0.0:1789478666.987736:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789478666.987742:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+22:17236:x1876403964537984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789478666.987816:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+22:17236:x1876403964537984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478666.987823:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789478666.987971:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964537984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789478666.989160:0:20331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789478666.989322:0:17236:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789478666.989340:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789478666.989349:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40f05e00/0x8ebaae74e821745c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217463 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478666.989359:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc40f05e00/0x8ebaae74e821745c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217463 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478666.989369:0:17236:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789478666.989371:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebc35b1c000 from 13 10000000:01000000:0.0:1789478666.989374:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789478666.989468:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40f04000/0x8ebaae74e821746a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478666.989477:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc40f04000/0x8ebaae74e821746a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478666.989486:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc40f04000/0x8ebaae74e821746a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478666.989518:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964538112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789478666.989573:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478666.989820:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc0636d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478666.989861:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964538112 00000100:00100000:1.0:1789478666.989867:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964538112 00000100:00100000:1.0:1789478666.989947:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789478666.989956:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+22:17236:x1876403964538112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789478666.989968:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478666.989980:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc40fcee00/0x8ebaae74e8217471 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e821746a expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478666.990012:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc40fcee00/0x8ebaae74e8217471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e821746a expref: 23 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478666.992525:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc40fcee00/0x8ebaae74e8217471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e821746a expref: 23 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478666.992554:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcee00, rc 0) 00000100:00100000:1.0:1789478666.992651:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+23:17236:x1876403964538112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2694us (3075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478666.992659:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789478666.992780:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964538112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789478666.992801:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc40f04000/0x8ebaae74e821746a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217471 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478666.992812:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc40f04000/0x8ebaae74e821746a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e8217471 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478666.992881:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964538240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789478666.992909:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478666.997010:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964538240 00000100:00100000:1.0:1789478666.997022:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964538240 00000100:00100000:1.0:1789478666.997068:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789478666.997078:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb01bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+23:17236:x1876403964538240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478666.997223:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb01bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d53a32c3-7c45-4781-893e-f633d5432f2d+23:17236:x1876403964538240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (4312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478666.997231:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789478666.997245:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc0636d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478666.997271:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964538240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789478666.997316:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964538368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789478666.997364:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478666.997389:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc0636d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478666.997568:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964538368 00000100:00100000:3.0:1789478666.997573:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964538368 00000100:00100000:3.0:1789478666.997694:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789478666.997702:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc0a5f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+23:17236:x1876403964538368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789478666.997777:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc0a5f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+23:17236:x1876403964538368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478666.997783:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789478666.997928:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964538368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789478666.999393:0:20332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789478666.999797:0:17236:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789478666.999820:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789478666.999830:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40f04000/0x8ebaae74e821746a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217471 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478666.999841:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc40f04000/0x8ebaae74e821746a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e8217471 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789478666.999867:0:17236:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789478666.999869:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ebb0372d800 from 13 10000000:01000000:0.0:1789478666.999872:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789478666.999901:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40f04600/0x8ebaae74e8217478 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478666.999909:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff8ebc40f04600/0x8ebaae74e8217478 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478666.999924:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff8ebc40f04600/0x8ebaae74e8217478 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478666.999945:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964538496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789478666.999996:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478667.000101:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964538496 00000100:00100000:3.0:1789478667.000108:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964538496 00000100:00100000:3.0:1789478667.000157:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789478667.000166:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc02eac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+23:17236:x1876403964538496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789478667.000176:0:17232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478667.000189:0:17232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc35b66a00/0x8ebaae74e821747f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ebaae74e8217478 expref: -99 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478667.000209:0:17232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc35b66a00/0x8ebaae74e821747f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ebaae74e8217478 expref: 24 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478667.000218:0:17232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc35b66a00/0x8ebaae74e821747f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ebaae74e8217478 expref: 24 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478667.000226:0:17232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b66a00, rc 0) 00000100:00100000:3.0:1789478667.000257:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc02eac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+24:17236:x1876403964538496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478667.000263:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789478667.000326:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc0636d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789478667.000343:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964538496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789478667.000355:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff8ebc40f04600/0x8ebaae74e8217478 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e821747f expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478667.000363:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff8ebc40f04600/0x8ebaae74e8217478 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ebaae74e821747f expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478667.000420:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964538624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789478667.000444:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478667.000464:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc0636d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478667.000574:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964538624 00000100:00100000:3.0:1789478667.000579:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964538624 00000100:00100000:3.0:1789478667.000636:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789478667.000642:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc02eaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+24:17236:x1876403964538624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789478667.000738:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc02eaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+24:17236:x1876403964538624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478667.000745:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789478667.000923:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964538624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789478667.000950:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964538752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789478667.000992:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478667.001017:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc0636d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789478667.001103:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964538752 00000100:00100000:3.0:1789478667.001107:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964538752 00000100:00100000:3.0:1789478667.001136:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789478667.001144:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc1a62f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+24:17236:x1876403964538752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789478667.001213:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc1a62f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+24:17236:x1876403964538752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478667.001219:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789478667.001310:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d53a32c3-7c45-4781-893e-f633d5432f2d:17236:1876403964538752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789478667.002260:0:20333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789478667.002391:0:17236:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789478667.002479:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789478667.002487:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff8ebc40f04600/0x8ebaae74e8217478 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e821747f expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478667.002499:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff8ebc40f04600/0x8ebaae74e8217478 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ebaae74e821747f expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478667.138675:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478667.138795:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945593984 00000100:00100000:3.0:1789478667.138805:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945593984 00000100:00100000:3.0:1789478667.138913:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 157 00000100:00100000:2.0:1789478667.138993:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc1a62fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+11:14904:x1876403945593984:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789478667.139025:0:17232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478667.139042:0:17232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc08c4be00/0x8ebaae74e8217486 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7769 expref: -99 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478667.139070:0:17232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc08c4be00/0x8ebaae74e8217486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7769 expref: 12 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478667.139081:0:17232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc08c4be00/0x8ebaae74e8217486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7769 expref: 12 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478667.139090:0:17232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4be00, rc 0) 00000100:00100000:2.0:1789478667.139150:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc1a62fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+12:14904:x1876403945593984:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 Request processed in 228us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478667.139158:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 157 00000100:00100000:0.0:1789478667.141483:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478667.141585:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945594112 00000100:00100000:1.0:1789478667.141620:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945594112 00000100:00100000:1.0:1789478667.141660:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 158 00000100:00100000:1.0:1789478667.141668:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+12:14904:x1876403945594112:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789478667.141815:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+12:14904:x1876403945594112:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 Request processed in 146us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478667.141823:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 158 00000100:00100000:3.0:1789478667.143770:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478667.145059:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945594240 00000100:00100000:2.0:1789478667.145071:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945594240 00000100:00100000:2.0:1789478667.145141:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 159 00000100:00100000:2.0:1789478667.145152:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+12:14904:x1876403945594240:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789478667.145303:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+12:14904:x1876403945594240:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 Request processed in 152us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478667.145311:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 159 00000100:00100000:2.0:1789478667.155191:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478667.155373:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945594368 00000100:00100000:3.0:1789478667.155382:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945594368 00000100:00100000:3.0:1789478667.155437:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 160 00000100:00100000:3.0:1789478667.155447:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+12:14904:x1876403945594368:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789478667.155462:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478667.155479:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ebc35b67000/0x8ebaae74e821748d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7770 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478667.155506:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ebc35b67000/0x8ebaae74e821748d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7770 expref: 13 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478667.155518:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ebc35b67000/0x8ebaae74e821748d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7770 expref: 13 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478667.155552:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b67000, rc 0) 00000100:00100000:3.0:1789478667.155633:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+13:14904:x1876403945594368:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 Request processed in 186us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478667.155640:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 160 00000100:00100000:3.0:1789478667.158379:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478667.158459:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945594496 00000100:00100000:2.0:1789478667.158467:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945594496 00000100:00100000:2.0:1789478667.158517:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 161 00000100:00100000:2.0:1789478667.158527:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+13:14904:x1876403945594496:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789478667.158703:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+13:14904:x1876403945594496:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 Request processed in 177us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478667.158710:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 161 00000100:00100000:2.0:1789478667.163295:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478667.163415:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945594624 00000100:00100000:1.0:1789478667.163424:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945594624 00000100:00100000:1.0:1789478667.163481:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 162 00000100:00100000:1.0:1789478667.163492:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+13:14904:x1876403945594624:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789478667.166787:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+13:14904:x1876403945594624:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 Request processed in 3288us (3491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478667.166801:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 162 00010000:00010000:1.0:1789478667.494972:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478667.494991:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964538880:0@lo:400:kworker.0 00000100:00100000:1.0:1789478667.495052:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478667.495083:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964539392:0@lo:400:kworker.0 00000100:00100000:1.0:1789478667.495104:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478667.495121:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964539904:0@lo:400:kworker.0 00000100:00100000:1.0:1789478667.495143:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478667.495163:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789478667.495168:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964539008:0@lo:400:kworker.0 00000100:00100000:1.0:1789478667.495188:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478667.495202:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964539520:0@lo:400:kworker.0 00000100:00100000:1.0:1789478667.495221:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478667.495237:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876403964540032:0@lo:400:kworker.0 00000100:00100000:1.0:1789478667.495256:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478667.495283:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964539136:0@lo:400:kworker.0 00000100:00100000:1.0:1789478667.495304:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478667.495319:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964539648:0@lo:400:kworker.0 00000100:00100000:1.0:1789478667.495337:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478667.495349:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876403964540160:0@lo:400:kworker.0 00000100:00100000:1.0:1789478667.495365:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478667.495387:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789478667.495392:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964539264:0@lo:400:kworker.0 00000100:00100000:1.0:1789478667.495415:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478667.495432:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964539776:0@lo:400:kworker.0 00000100:00100000:1.0:1789478667.495453:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478667.495478:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964538880 00000100:00100000:1.0:1789478667.495484:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964538880 00000100:00100000:1.0:1789478667.495533:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964539392 00000100:00100000:1.0:1789478667.495536:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964539392 00000100:00100000:1.0:1789478667.495574:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964539008 00000100:00100000:1.0:1789478667.495577:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964539008 00000100:00100000:1.0:1789478667.495588:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964539520 00000100:00100000:1.0:1789478667.495590:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964539520 00000100:00100000:1.0:1789478667.495625:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789478667.496240:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964538880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478667.496297:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964538880:12345-0@lo:400:kworker.0 Request processed in 663us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478667.496304:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789478667.496322:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789478667.496328:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964539392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478667.496356:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964539392:12345-0@lo:400:kworker.0 Request processed in 30us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478667.496362:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789478667.496377:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789478667.496386:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964539008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478667.496393:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964540416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789478667.496423:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964539008:12345-0@lo:400:kworker.0 Request processed in 38us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478667.496430:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789478667.496433:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478667.496471:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964539008:0@lo:400:kworker.0 00000100:00100000:2.0:1789478667.496484:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964538880:0@lo:400:kworker.0 00000100:00100000:2.0:1789478667.496492:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964539392:0@lo:400:kworker.0 00000100:00100000:1.0:1789478667.496514:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789478667.496523:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964539520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478667.496528:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789478667.496537:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc09125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964540544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789478667.496879:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964539520:12345-0@lo:400:kworker.0 Request processed in 357us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478667.496887:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789478667.496911:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964539904 00000100:00100000:1.0:1789478667.496915:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964539904 00000100:00100000:1.0:1789478667.496938:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964540032 00000100:00100000:1.0:1789478667.496941:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964540032 00000100:00100000:2.0:1789478667.496984:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478667.497067:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964539520:0@lo:400:kworker.0 00000100:00100000:3.0:1789478667.497109:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964540416 00000100:00100000:3.0:1789478667.497114:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964540416 00000100:00100000:3.0:1789478667.497135:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964540544 00000100:00100000:3.0:1789478667.497138:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964540544 00000100:00100000:3.0:1789478667.497151:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789478667.497158:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964540416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789478667.497172:0:18750:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789478667.497208:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964539136 00000100:00100000:1.0:1789478667.497213:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964539136 00000100:00100000:3.0:1789478667.497217:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964540416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478667.497224:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789478667.497229:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964539648 00000100:00100000:1.0:1789478667.497233:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964539648 00000100:00100000:3.0:1789478667.497242:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789478667.497247:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964540160 00000100:00100000:1.0:1789478667.497252:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964540160 00000100:00100000:3.0:1789478667.497253:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964540544:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789478667.497270:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964539776 00000100:00100000:1.0:1789478667.497275:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964539776 00002000:00000024:3.0:1789478667.497286:0:18750:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789478667.497292:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789478667.497301:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964539904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789478667.497319:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964540544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478667.497326:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789478667.497348:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876403964539904:12345-0@lo:400:kworker.0 Request processed in 47us (2202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478667.497355:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789478667.497361:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc09125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964540544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789478667.497374:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789478667.497380:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964540416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789478667.497385:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876403964540032:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789478667.497399:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c963b80 x1876403964539904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478667.497418:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876403964540032:12345-0@lo:400:kworker.0 Request processed in 36us (2160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478667.497422:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876403964539904:0@lo:400:kworker.0 00000100:00100000:1.0:1789478667.497428:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789478667.497445:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789478667.497466:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876403964540032:0@lo:400:kworker.0 00000100:00100000:2.0:1789478667.498755:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964539264 00000100:00100000:2.0:1789478667.498765:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964539264 00000100:00100000:0.0:1789478667.499509:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964540288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789478667.499587:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789478667.500077:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789478667.500137:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964539136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478667.500207:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876403964539136:12345-0@lo:400:kworker.0 Request processed in 2756us (4901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478667.500216:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789478667.500242:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789478667.500317:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964540288 00000100:00100000:3.0:1789478667.500325:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964540288 00000100:00100000:3.0:1789478667.500372:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789478667.500383:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964540288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789478667.500406:0:18750:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789478667.500552:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964540288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 160us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478667.500558:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789478667.500737:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb0359ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964540288:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789478667.504048:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789478667.504056:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789478667.504059:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789478667.504081:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789478667.504096:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964539264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478667.504191:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964539264:12345-0@lo:400:kworker.0 Request processed in 98us (8773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478667.504198:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789478667.504205:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876403964539136:0@lo:400:kworker.0 00000100:00100000:2.0:1789478667.504229:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789478667.504239:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876403964540160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478667.504243:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964539264:0@lo:400:kworker.0 00000100:00100000:2.0:1789478667.504285:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876403964540160:12345-0@lo:400:kworker.0 Request processed in 49us (8918us total) trans 0 rc 0/0 00010000:00080000:0.0:1789478667.504301:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebc3c963100 x1876403964540160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789478667.504309:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789478667.504320:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876403964540160:0@lo:400:kworker.0 00000100:00100000:1.0:1789478667.504375:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03e98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964539648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478667.504537:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789478667.504560:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc34cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964539776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789478667.505005:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc34cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876403964539776:12345-0@lo:400:kworker.0 Request processed in 446us (9549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478667.505012:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789478667.505037:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03e98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876403964539648:12345-0@lo:400:kworker.0 Request processed in 4784us (9694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478667.505047:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789478667.505279:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876403964539648:0@lo:400:kworker.0 00000100:00100000:0.0:1789478667.505302:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876403964539776:0@lo:400:kworker.0 00010000:00010000:1.0:1789478668.517114:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478669.257267:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478669.257348:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945594752 00000100:00100000:1.0:1789478669.257357:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945594752 00000100:00100000:1.0:1789478669.257416:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 23 00000100:00100000:1.0:1789478669.257426:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+6:15572:x1876403945594752:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789478669.257444:0:17240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478669.257464:0:17240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8217494 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7777 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257516:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e821749b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257529:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e821749b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257554:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e821749b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257566:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257588:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257624:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257687:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e82174a9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257694:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e82174a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257700:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e82174a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478669.257724:0:17240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789478669.257727:0:17240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789478669.257758:0:17240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e82174a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257767:0:17240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e821749b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257774:0:17240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e821749b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257780:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e821749b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257786:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfe00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478669.257790:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e821749b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257803:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e821749b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257814:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc34e78100) 00010000:00010000:1.0:1789478669.257817:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478669.257820:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e821749b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257826:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e821749b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257838:0:17240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257844:0:17240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257850:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257854:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcea00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478669.257857:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257863:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257868:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8ebc3523b700) 00010000:00010000:1.0:1789478669.257870:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478669.257873:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257886:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257913:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8217494 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7777 expref: 8 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257924:0:17240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce800/0x8ebaae74e82174a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7777 expref: 7 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.257931:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ebc3523b900) 00010000:00010000:1.0:1789478669.257933:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789478669.257936:0:17240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fce800, rc 0) 00000100:00100000:1.0:1789478669.257984:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+7:15572:x1876403945594752:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 560us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478669.257990:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 23 00000100:00080000:0.0:1789478669.258074:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789478669.263615:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478669.263689:0:17249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945594880 00000100:00100000:1.0:1789478669.263698:0:17249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945594880 00000100:00100000:1.0:1789478669.263753:0:17249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:1.0:1789478669.263764:0:17249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cca3a112-296c-4f03-abf1-9544e970264f+7:15572:x1876403945594880:12345-192.168.206.11@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789478669.263843:0:17249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cca3a112-296c-4f03-abf1-9544e970264f+7:15572:x1876403945594880:12345-192.168.206.11@tcp:900:lhsmtool_posix.0 Request processed in 81us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478669.263851:0:17249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:3.0:1789478669.282487:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478669.284405:0:18465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945595136 00000100:00100000:2.0:1789478669.284417:0:18465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945595136 00000100:00100000:2.0:1789478669.284482:0:18465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:2.0:1789478669.284492:0:18465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca3a112-296c-4f03-abf1-9544e970264f+7:15572:x1876403945595136:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789478669.284510:0:18465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478669.284529:0:18465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e82174b0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b777e expref: -99 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.284682:0:18465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e82174b7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.284697:0:18465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e82174b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.284708:0:18465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e82174b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.284807:0:18465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e82174be lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.284826:0:18465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e82174be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.284847:0:18465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e82174be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.284948:0:18465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e82174c5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.284956:0:18465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e82174c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.284963:0:18465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e82174c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478669.284974:0:18465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789478669.285122:0:18465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e82174b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.285130:0:18465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e82174b7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.285135:0:18465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e82174b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.285140:0:18465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4ae00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478669.285144:0:18465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e82174b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.285150:0:18465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e82174b7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.285161:0:18465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ebc3523b900) 00010000:00010000:2.0:1789478669.285163:0:18465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478669.285180:0:18465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e82174b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.285186:0:18465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e82174b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.285201:0:18465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e82174be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.285207:0:18465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e82174be lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.285212:0:18465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e82174be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.285218:0:18465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4a200 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478669.285221:0:18465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e82174be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.285227:0:18465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e82174be lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.285235:0:18465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ebc34e09c00) 00010000:00010000:2.0:1789478669.285237:0:18465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478669.285239:0:18465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e82174be lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.285244:0:18465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e82174be lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.287327:0:18465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e82174b0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b777e expref: 10 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.287366:0:18465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b600/0x8ebaae74e82174c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b777e expref: 9 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.287375:0:18465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ebc34e09700) 00010000:00010000:2.0:1789478669.287378:0:18465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478669.287380:0:18465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4b600, rc 0) 00000100:00100000:2.0:1789478669.287440:0:18465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca3a112-296c-4f03-abf1-9544e970264f+9:15572:x1876403945595136:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 2948us (4960us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789478669.287449:0:18465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:2.0:1789478669.289792:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478669.290258:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945595264 00000100:00100000:1.0:1789478669.290268:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945595264 00000100:00100000:1.0:1789478669.290325:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:1.0:1789478669.290335:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+9:15572:x1876403945595264:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789478669.290440:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+9:15572:x1876403945595264:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 Request processed in 106us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478669.290449:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:0.0:1789478669.292478:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478669.292557:0:18465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945595392 00000100:00100000:2.0:1789478669.292565:0:18465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945595392 00000100:00100000:2.0:1789478669.292652:0:18465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 26 00000100:00100000:2.0:1789478669.292662:0:18465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca3a112-296c-4f03-abf1-9544e970264f+5:15572:x1876403945595392:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1789478669.292753:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1789478669.296039:0:18465:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3342us 00000100:00100000:2.0:1789478669.303301:0:18465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca3a112-296c-4f03-abf1-9544e970264f+5:15572:x1876403945595392:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 Request processed in 10629us (10818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478669.303315:0:18465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 26 00000100:00100000:3.0:1789478669.336759:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478669.336899:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945595520 00000100:00100000:1.0:1789478669.336909:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945595520 00000100:00100000:1.0:1789478669.336968:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 27 00000100:00100000:1.0:1789478669.336979:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+9:15578:x1876403945595520:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1789478669.336997:0:17240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478669.337016:0:17240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7785 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.337086:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82174da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.337101:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82174da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.337113:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82174da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.337126:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82174e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.337133:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82174e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.337139:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82174e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.337173:0:17240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82174da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.337192:0:17240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82174da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.337199:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82174da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.337204:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfe00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478669.337209:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82174da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.337216:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82174da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.337228:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc34e78100) 00010000:00010000:1.0:1789478669.337231:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478669.337236:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82174da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.337251:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82174da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.337265:0:17240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82174e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.337271:0:17240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82174e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.337277:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82174e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.337282:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfc00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478669.337292:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82174e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.337299:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82174e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.337307:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ebc3523b700) 00010000:00010000:1.0:1789478669.337310:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478669.337313:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82174e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.337318:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82174e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.337348:0:17240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174d3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7785 expref: 10 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.337358:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc34e78100) 00010000:00010000:1.0:1789478669.337360:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478669.337364:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7785 expref: 10 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.337374:0:17240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcea00, rc 0) 00000100:00100000:1.0:1789478669.337430:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+9:15578:x1876403945595520:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 453us (679us total) trans 0 rc 301/301 00000100:00100000:1.0:1789478669.337438:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 27 00000100:00100000:1.0:1789478669.346518:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478669.346832:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945595648 00000100:00100000:2.0:1789478669.346842:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945595648 00000100:00100000:2.0:1789478669.346897:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:2.0:1789478669.346908:0:17247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cca3a112-296c-4f03-abf1-9544e970264f+9:15578:x1876403945595648:12345-192.168.206.11@tcp:700:lfs.0 00000100:00100000:2.0:1789478669.346990:0:17247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cca3a112-296c-4f03-abf1-9544e970264f+9:15578:x1876403945595648:12345-192.168.206.11@tcp:700:lfs.0 Request processed in 83us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478669.346997:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:0.0:1789478669.353020:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478669.353116:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945595904 00000100:00100000:1.0:1789478669.353126:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945595904 00000100:00100000:1.0:1789478669.353185:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 28 00000100:00100000:1.0:1789478669.353211:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03feed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+9:15578:x1876403945595904:12345-192.168.206.11@tcp:36:lfs.0 00010000:00010000:1.0:1789478669.353272:0:17238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478669.353296:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e8217401 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b76f2 expref: 9 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.353315:0:17238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc34e78100) 00010000:00010000:1.0:1789478669.353320:0:17238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789478669.353371:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.353385:0:17238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217440 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7762 expref: 5 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.353394:0:17238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174e8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.353434:0:17238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217440 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7762 expref: 5 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.353447:0:17238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217440 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7762 expref: 5 pid: 17239 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478669.353461:0:17238:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17238:1876403964540672:192.168.206.11@tcp:104: 00000100:00100000:1.0:1789478669.353544:0:17238:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40dfc180 going to sleep for 11 seconds 00000100:00100000:3.0:1789478669.366789:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478669.366861:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945596032 00000100:00100000:0.0:1789478669.366870:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945596032 00000100:00100000:1.0:1789478669.366952:0:17238:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17238:1876403964540672:192.168.206.11@tcp:104: 00010000:00010000:0.0:1789478669.366966:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217440 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7762 expref: 6 pid: 17239 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.366975:0:17238:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478669.367004:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00100000:0.0:1789478669.367013:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04485c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d59ee182-687f-47d8-811d-4824d67b8550+6:2396:x1876403945596032:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478669.367026:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478669.367033:0:17226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217440 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7762 expref: 6 pid: 17239 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478669.367045:0:17226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217440 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7762 expref: 6 pid: 17239 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478669.367065:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217440 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7762 expref: 6 pid: 17239 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478669.367081:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc34e78100) 00010000:00010000:0.0:1789478669.367086:0:17226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478669.367103:0:17226:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478669.367109:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174e8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478669.367135:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478669.367184:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04485c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d59ee182-687f-47d8-811d-4824d67b8550+5:2396:x1876403945596032:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 172us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478669.367191:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00080000:3.0:1789478669.369352:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789478669.371646:0:17238:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.371662:0:17238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.371694:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82174ef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.371706:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82174ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.371716:0:17238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82174ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.377300:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82174f6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.377321:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82174f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.377333:0:17238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82174f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789478669.377351:0:17238:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068a781e8 reply state 00000000b8a14fa9 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82174f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.377362:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82174f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.377370:0:17238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ebc3523b400) 00010000:00010000:1.0:1789478669.377378:0:17238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789478669.377383:0:17238:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789478669.377389:0:17238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789478669.377398:0:17238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.377405:0:17238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174e8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.377412:0:17238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.377417:0:17238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcea00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478669.377421:0:17238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.377428:0:17238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174e8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.377439:0:17238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc34e78100) 00010000:00010000:1.0:1789478669.377441:0:17238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478669.377445:0:17238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174e8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.377451:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174e8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789478669.377468:0:17238:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068a781e8 reply state 00000000b8a14fa9 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82174ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.377477:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82174ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.377493:0:17238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ebc3523b700) 00010000:00010000:1.0:1789478669.377495:0:17238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789478669.377497:0:17238:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789478669.377666:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03feed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+10:15578:x1876403945595904:12345-192.168.206.11@tcp:36:lfs.0 Request processed in 24454us (24650us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789478669.377675:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 28 00000100:00100000:3.0:1789478669.477389:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478669.478065:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945596160 00000100:00100000:1.0:1789478669.478076:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945596160 00000100:00100000:1.0:1789478669.478308:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 29 00000100:00100000:1.0:1789478669.478320:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+10:15586:x1876403945596160:12345-192.168.206.11@tcp:101:lctl.0 00010000:00010000:1.0:1789478669.478344:0:17240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478669.478365:0:17240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b778c expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.478929:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8217504 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.478944:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8217504 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.478954:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8217504 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478669.478993:0:17240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789478669.478997:0:17240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789478669.479032:0:17240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8217504 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.479060:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82174fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b778c expref: 12 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.479077:0:17240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a600/0x8ebaae74e8217504 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b778c expref: 11 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.479086:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc3523b800) 00010000:00010000:2.0:1789478669.479089:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789478669.479093:0:17240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4a600, rc 0) 00000100:00100000:2.0:1789478669.479202:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+11:15586:x1876403945596160:12345-192.168.206.11@tcp:101:lctl.0 Request processed in 884us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478669.479210:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 29 00000100:00100000:3.0:1789478669.505872:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478669.506146:0:18465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945596288 00000100:00100000:2.0:1789478669.506157:0:18465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945596288 00000100:00100000:2.0:1789478669.506388:0:18465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 30 00000100:00100000:2.0:1789478669.506400:0:18465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d59ee182-687f-47d8-811d-4824d67b8550+5:15587:x1876403945596288:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:2.0:1789478669.506437:0:18465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478669.506467:0:18465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e821750b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7793 expref: -99 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.506539:0:18465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8217512 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.506554:0:18465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8217512 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.506564:0:18465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8217512 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478669.506643:0:18465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789478669.506648:0:18465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789478669.506670:0:18465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8217512 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.506693:0:18465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e821750b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7793 expref: 7 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.506709:0:18465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ae00/0x8ebaae74e8217512 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7793 expref: 6 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.506718:0:18465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc3523b800) 00010000:00010000:2.0:1789478669.506720:0:18465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789478669.506724:0:18465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4ae00, rc 0) 00000100:00100000:2.0:1789478669.506780:0:18465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d59ee182-687f-47d8-811d-4824d67b8550+6:15587:x1876403945596288:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 383us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478669.506787:0:18465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 30 00000100:00100000:0.0:1789478669.511991:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478669.512416:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945596416 00000100:00100000:2.0:1789478669.512425:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945596416 00000100:00100000:2.0:1789478669.512688:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 31 00000100:00100000:2.0:1789478669.512700:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d59ee182-687f-47d8-811d-4824d67b8550+6:15587:x1876403945596416:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:2.0:1789478669.512721:0:17239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478669.512742:0:17239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8217519 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b779a expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.512801:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8217520 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.512815:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8217520 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.512835:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8217520 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.512848:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217527 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.512856:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217527 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.512862:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217527 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.512935:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e821752e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.512943:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e821752e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.512966:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e821752e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478669.513002:0:17239:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789478669.513006:0:17239:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789478669.513023:0:17239:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e821752e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.513035:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8217520 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.513042:0:17239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8217520 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.513049:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8217520 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.513055:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4b400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478669.513059:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8217520 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.513066:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8217520 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.513077:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc3523b800) 00010000:00010000:2.0:1789478669.513080:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478669.513084:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8217520 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.513091:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e8217520 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.513114:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217527 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.513120:0:17239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217527 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.513126:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217527 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.513132:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4aa00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478669.513135:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217527 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.513142:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217527 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.513150:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ebc3523b700) 00010000:00010000:2.0:1789478669.513153:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478669.513156:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217527 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.513161:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217527 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.513187:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8217519 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b779a expref: 8 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.513199:0:17239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e821752e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b779a expref: 7 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.513219:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ebc3523b400) 00010000:00010000:2.0:1789478669.513221:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789478669.513224:0:17239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4b200, rc 0) 00000100:00100000:2.0:1789478669.513287:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d59ee182-687f-47d8-811d-4824d67b8550+7:15587:x1876403945596416:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 589us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478669.513294:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 31 00000100:00100000:2.0:1789478669.519478:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478669.519667:0:17249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945596544 00000100:00100000:1.0:1789478669.519677:0:17249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945596544 00000100:00100000:1.0:1789478669.519795:0:17249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00100000:1.0:1789478669.519805:0:17249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc09125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d59ee182-687f-47d8-811d-4824d67b8550+5:15587:x1876403945596544:12345-192.168.206.11@tcp:900:lfs.0 00000100:00100000:1.0:1789478669.519904:0:17249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc09125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d59ee182-687f-47d8-811d-4824d67b8550+5:15587:x1876403945596544:12345-192.168.206.11@tcp:900:lfs.0 Request processed in 99us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478669.519911:0:17249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00080000:3.0:1789478669.520720:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789478669.525511:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478669.526244:0:18465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945596800 00000100:00100000:2.0:1789478669.526255:0:18465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945596800 00000100:00100000:2.0:1789478669.526317:0:18465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 32 00000100:00100000:2.0:1789478669.526327:0:18465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d59ee182-687f-47d8-811d-4824d67b8550+7:15587:x1876403945596800:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:2.0:1789478669.526345:0:18465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478669.526365:0:18465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8217535 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b77a1 expref: -99 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478669.526467:0:18465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789478669.526570:0:18465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8217535 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77a1 expref: 9 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.526585:0:18465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc3523b800) 00010000:00010000:2.0:1789478669.526588:0:18465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789478669.526623:0:18465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8217535 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77a1 expref: 9 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.526638:0:18465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4b800, rc 0) 00000100:00100000:2.0:1789478669.526700:0:18465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d59ee182-687f-47d8-811d-4824d67b8550+8:15587:x1876403945596800:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 375us (1197us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789478669.526720:0:18465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 32 00000100:00100000:0.0:1789478669.530683:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478669.530891:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945597056 00000100:00100000:2.0:1789478669.530900:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945597056 00000100:00100000:2.0:1789478669.530961:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 33 00000100:00100000:2.0:1789478669.530972:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d59ee182-687f-47d8-811d-4824d67b8550+8:15587:x1876403945597056:12345-192.168.206.11@tcp:36:lfs.0 00010000:00010000:2.0:1789478669.531036:0:17240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478669.531060:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e821752e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b779a expref: 8 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.531086:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ebc3523b400) 00010000:00010000:2.0:1789478669.531091:0:17240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789478669.531112:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217543 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.531123:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217543 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.531132:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217543 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789478669.531331:0:17240:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f78ec8cc reply state 000000005ad6a404 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217543 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.531343:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217543 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.531350:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ebc3523b400) 00010000:00010000:2.0:1789478669.531352:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1789478669.531361:0:17240:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789478669.531368:0:17240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789478669.531453:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d59ee182-687f-47d8-811d-4824d67b8550+9:15587:x1876403945597056:12345-192.168.206.11@tcp:36:lfs.0 Request processed in 483us (777us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789478669.531460:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 33 00000100:00100000:3.0:1789478669.533653:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478669.534760:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945597312 00000100:00100000:2.0:1789478669.534784:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945597312 00000100:00100000:2.0:1789478669.535325:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 2 00000100:00100000:2.0:1789478669.535339:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d59ee182-687f-47d8-811d-4824d67b8550+9:15587:x1876403945597312:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:2.0:1789478669.535689:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d59ee182-687f-47d8-811d-4824d67b8550+10:15587:x1876403945597312:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 352us (2040us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789478669.535697:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 2 00010000:00010000:3.0:1789478669.540787:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478669.543778:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478669.543863:0:18465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945597568 00000100:00100000:3.0:1789478669.543871:0:18465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945597568 00000100:00100000:3.0:1789478669.543927:0:18465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 34 00000100:00100000:3.0:1789478669.543951:0:18465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d59ee182-687f-47d8-811d-4824d67b8550+10:15587:x1876403945597568:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1789478669.543975:0:18465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478669.544017:0:18465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e821754a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b77a8 expref: -99 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.544084:0:18465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67800/0x8ebaae74e8217551 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.544098:0:18465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67800/0x8ebaae74e8217551 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.544111:0:18465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67800/0x8ebaae74e8217551 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.544123:0:18465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66000/0x8ebaae74e8217558 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.544129:0:18465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66000/0x8ebaae74e8217558 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.544136:0:18465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66000/0x8ebaae74e8217558 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478669.544683:0:18465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789478669.544753:0:18465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67800/0x8ebaae74e8217551 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.544761:0:18465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67800/0x8ebaae74e8217551 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.544767:0:18465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67800/0x8ebaae74e8217551 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.544784:0:18465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478669.544788:0:18465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67800/0x8ebaae74e8217551 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.544795:0:18465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67800/0x8ebaae74e8217551 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.544807:0:18465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc3523b800) 00010000:00010000:3.0:1789478669.544809:0:18465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478669.544813:0:18465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67800/0x8ebaae74e8217551 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.544818:0:18465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67800/0x8ebaae74e8217551 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.544967:0:18465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66000/0x8ebaae74e8217558 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.544974:0:18465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66000/0x8ebaae74e8217558 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.544980:0:18465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66000/0x8ebaae74e8217558 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.544984:0:18465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b66000 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478669.544987:0:18465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66000/0x8ebaae74e8217558 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.544992:0:18465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66000/0x8ebaae74e8217558 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.545302:0:18465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ebc3523b700) 00010000:00010000:3.0:1789478669.545304:0:18465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478669.545308:0:18465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66000/0x8ebaae74e8217558 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.545313:0:18465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66000/0x8ebaae74e8217558 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.545350:0:18465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e821754a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77a8 expref: 12 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.545360:0:18465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc3523b800) 00010000:00010000:3.0:1789478669.545363:0:18465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789478669.545366:0:18465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e821754a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77a8 expref: 12 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.545375:0:18465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b66e00, rc 0) 00000100:00100000:3.0:1789478669.546283:0:18465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d59ee182-687f-47d8-811d-4824d67b8550+11:15587:x1876403945597568:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 2329us (2517us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1789478669.546293:0:18465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 34 00000100:00100000:0.0:1789478669.551875:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478669.551942:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945597696 00000100:00100000:2.0:1789478669.551952:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945597696 00000100:00100000:3.0:1789478669.552106:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 35 00000100:00100000:3.0:1789478669.552120:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d59ee182-687f-47d8-811d-4824d67b8550+11:15587:x1876403945597696:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1789478669.552141:0:17239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478669.552161:0:17239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66400/0x8ebaae74e8217566 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b77af expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.552255:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e821756d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.552280:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e821756d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.552291:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e821756d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478669.552318:0:17239:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789478669.552321:0:17239:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789478669.552338:0:17239:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e821756d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.552362:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66400/0x8ebaae74e8217566 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77af expref: 13 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.552378:0:17239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e821756d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77af expref: 12 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.552387:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ebc3523b400) 00010000:00010000:3.0:1789478669.552389:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789478669.552392:0:17239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b66800, rc 0) 00000100:00100000:3.0:1789478669.552925:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d59ee182-687f-47d8-811d-4824d67b8550+12:15587:x1876403945597696:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 477us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478669.552932:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 35 00000100:00100000:0.0:1789478669.558759:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478669.558939:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945597824 00000100:00100000:3.0:1789478669.558948:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945597824 00000100:00100000:3.0:1789478669.558999:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:3.0:1789478669.559007:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d59ee182-687f-47d8-811d-4824d67b8550+12:15587:x1876403945597824:12345-192.168.206.11@tcp:37:lfs.0 00000100:00100000:0.0:1789478669.572395:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d59ee182-687f-47d8-811d-4824d67b8550+12:15587:x1876403945597824:12345-192.168.206.11@tcp:37:lfs.0 Request processed in 13378us (13634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478669.572412:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:0.0:1789478669.576968:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478669.577064:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945598080 00000100:00100000:2.0:1789478669.577074:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945598080 00000100:00100000:2.0:1789478669.577129:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:2.0:1789478669.577141:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08d2e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d59ee182-687f-47d8-811d-4824d67b8550+12:15587:x1876403945598080:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:2.0:1789478669.577453:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08d2e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d59ee182-687f-47d8-811d-4824d67b8550+13:15587:x1876403945598080:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 313us (493us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789478669.577463:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:3.0:1789478669.654121:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478669.655572:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945598208 00000100:00100000:1.0:1789478669.655585:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945598208 00000100:00100000:1.0:1789478669.655662:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 36 00000100:00100000:1.0:1789478669.655673:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+11:15593:x1876403945598208:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:1.0:1789478669.655702:0:17238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478669.655721:0:17238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8217574 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b77b6 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.655781:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e821757b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.655793:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e821757b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.655805:0:17238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e821757b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.655816:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf400/0x8ebaae74e8217582 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.655824:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf400/0x8ebaae74e8217582 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.655830:0:17238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf400/0x8ebaae74e8217582 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.655901:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e8217589 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.655911:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e8217589 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.655917:0:17238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e8217589 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478669.655945:0:17238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789478669.655955:0:17238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789478669.655995:0:17238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e8217589 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.656007:0:17238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e821757b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.656013:0:17238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e821757b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.656019:0:17238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e821757b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.656025:0:17238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcf600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478669.656029:0:17238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e821757b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.656110:0:17238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e821757b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.656123:0:17238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc3523b800) 00010000:00010000:1.0:1789478669.656125:0:17238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478669.656130:0:17238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e821757b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.656135:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e821757b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.656146:0:17238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf400/0x8ebaae74e8217582 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.656153:0:17238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf400/0x8ebaae74e8217582 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.656169:0:17238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf400/0x8ebaae74e8217582 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.656174:0:17238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcf400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478669.656178:0:17238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf400/0x8ebaae74e8217582 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.656184:0:17238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf400/0x8ebaae74e8217582 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.656191:0:17238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ebc3523b700) 00010000:00010000:1.0:1789478669.656194:0:17238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478669.656197:0:17238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf400/0x8ebaae74e8217582 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.656344:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf400/0x8ebaae74e8217582 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.656373:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e8217574 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77b6 expref: 13 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.656385:0:17238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce400/0x8ebaae74e8217589 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77b6 expref: 12 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.656392:0:17238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ebc3523b400) 00010000:00010000:1.0:1789478669.656394:0:17238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789478669.656397:0:17238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fce400, rc 0) 00000100:00100000:1.0:1789478669.656450:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+12:15593:x1876403945598208:12345-192.168.206.11@tcp:101:bash.0 Request processed in 779us (2336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478669.656467:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 36 00000100:00100000:1.0:1789478669.661846:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478669.661934:0:17249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945598336 00000100:00100000:2.0:1789478669.661942:0:17249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945598336 00000100:00100000:2.0:1789478669.661998:0:17249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:2.0:1789478669.662008:0:17249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cca3a112-296c-4f03-abf1-9544e970264f+5:15593:x1876403945598336:12345-192.168.206.11@tcp:900:bash.0 00000100:00100000:2.0:1789478669.662098:0:17249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cca3a112-296c-4f03-abf1-9544e970264f+5:15593:x1876403945598336:12345-192.168.206.11@tcp:900:bash.0 Request processed in 90us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478669.662121:0:17249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:0.0:1789478669.669886:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478669.669970:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945598592 00000100:00100000:3.0:1789478669.669979:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945598592 00000100:00100000:3.0:1789478669.670033:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 37 00000100:00100000:3.0:1789478669.670043:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca3a112-296c-4f03-abf1-9544e970264f+12:15593:x1876403945598592:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:3.0:1789478669.670061:0:17239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478669.670079:0:17239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66400/0x8ebaae74e8217590 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b77bd expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.670187:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8217597 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.670216:0:17239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e821756d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77af expref: 12 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.670226:0:17239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8217597 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.670258:0:17239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e821756d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77af expref: 12 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.670271:0:17239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e821756d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77af expref: 12 pid: 17239 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478669.670285:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04485f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17239:1876403964540800:192.168.206.11@tcp:104: 00000100:00100000:3.0:1789478669.670363:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05297480 going to sleep for 11 seconds 00000100:00100000:0.0:1789478669.675957:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478669.676052:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945598720 00000100:00100000:1.0:1789478669.676061:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945598720 00010000:00010000:1.0:1789478669.676100:0:17224:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e821756d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77af expref: 13 pid: 17239 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478669.676148:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:1.0:1789478669.676158:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08884000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d59ee182-687f-47d8-811d-4824d67b8550+13:2396:x1876403945598720:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789478669.676171:0:17224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478669.676178:0:17224:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e821756d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77af expref: 13 pid: 17239 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.676190:0:17224:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e821756d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77af expref: 13 pid: 17239 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.676442:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ebc3523b400) 00010000:00010000:1.0:1789478669.676448:0:17224:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8217597 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.676457:0:17224:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8217597 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.676465:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8217597 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.676483:0:17224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478669.676543:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08884000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d59ee182-687f-47d8-811d-4824d67b8550+13:2396:x1876403945598720:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 386us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478669.676565:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 16 00010000:00010000:3.0:1789478669.677248:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e821756d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77af expref: 12 pid: 17239 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478669.677266:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04485f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17239:1876403964540800:192.168.206.11@tcp:104: 00010000:00010000:3.0:1789478669.677293:0:17239:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8217597 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.677303:0:17239:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8217597 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.677309:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8217597 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.677330:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66000/0x8ebaae74e821759e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.677339:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66000/0x8ebaae74e821759e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.677346:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66000/0x8ebaae74e821759e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.677819:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67800/0x8ebaae74e82175a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.677829:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67800/0x8ebaae74e82175a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.677836:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67800/0x8ebaae74e82175a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478669.677847:0:17239:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789478669.677871:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8217597 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.677879:0:17239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8217597 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.677898:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8217597 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.677905:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b66e00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478669.677909:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8217597 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.677917:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8217597 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.677930:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ebc3523b400) 00010000:00010000:3.0:1789478669.677933:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789478669.677937:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8217597 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.677942:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e8217597 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789478669.677952:0:17239:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000025762d2 reply state 0000000090fae549 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66000/0x8ebaae74e821759e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.677961:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66000/0x8ebaae74e821759e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.677966:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8ebb02552500) 00010000:00010000:3.0:1789478669.677969:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789478669.677971:0:17239:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789478669.678005:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66400/0x8ebaae74e8217590 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77bd expref: 15 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.678018:0:17239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67800/0x8ebaae74e82175a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77bd expref: 14 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.678043:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ebb02552600) 00010000:00010000:3.0:1789478669.678046:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789478669.678048:0:17239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b67800, rc 0) 00000100:00100000:3.0:1789478669.678102:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca3a112-296c-4f03-abf1-9544e970264f+15:15593:x1876403945598592:12345-192.168.206.11@tcp:101:bash.0 Request processed in 8059us (8223us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789478669.678110:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 37 00000100:00100000:0.0:1789478669.695526:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478669.695627:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945598848 00000100:00100000:1.0:1789478669.695636:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945598848 00000100:00100000:1.0:1789478669.695698:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 38 00000100:00100000:1.0:1789478669.695708:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+15:15593:x1876403945598848:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:1.0:1789478669.695730:0:17238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478669.695747:0:17238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82175b3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b77c4 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.695808:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce200/0x8ebaae74e82175ba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.695821:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce200/0x8ebaae74e82175ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.695832:0:17238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce200/0x8ebaae74e82175ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478669.695957:0:17238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789478669.695962:0:17238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789478669.696118:0:17238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce200/0x8ebaae74e82175ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.696129:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce200/0x8ebaae74e82175ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.696152:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82175b3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77c4 expref: 17 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.696169:0:17238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce200/0x8ebaae74e82175ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77c4 expref: 16 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478669.696189:0:17238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ebb02552600) 00010000:00010000:1.0:1789478669.696192:0:17238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789478669.696196:0:17238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fce200, rc 0) 00000100:00100000:1.0:1789478669.696729:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+16:15593:x1876403945598848:12345-192.168.206.11@tcp:101:bash.0 Request processed in 1019us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478669.696739:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 38 00000100:00100000:1.0:1789478669.702417:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478669.702504:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945599104 00000100:00100000:0.0:1789478669.702513:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945599104 00000100:00100000:0.0:1789478669.714147:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:0.0:1789478669.714164:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cca3a112-296c-4f03-abf1-9544e970264f+16:15593:x1876403945599104:12345-192.168.206.11@tcp:35:bash.0 00000100:00100000:0.0:1789478669.714428:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cca3a112-296c-4f03-abf1-9544e970264f+17:15593:x1876403945599104:12345-192.168.206.11@tcp:35:bash.0 Request processed in 270us (12225us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1789478669.714451:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 5 00000040:00080000:1.0:1789478669.734998:0:17992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789478669.821076:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478669.821204:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945599360 00000100:00100000:2.0:1789478669.821213:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945599360 00000100:00100000:2.0:1789478669.821272:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 39 00000100:00100000:2.0:1789478669.821282:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+17:15603:x1876403945599360:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:2.0:1789478669.821305:0:17240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478669.821324:0:17240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e82175c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b77cb expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478669.821416:0:17240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789478669.821506:0:17240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e82175c1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77cb expref: 19 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.821520:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ebc3523b800) 00010000:00010000:2.0:1789478669.821523:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789478669.821539:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e82175c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77cb expref: 19 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.821554:0:17240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4b200, rc 0) 00000100:00100000:2.0:1789478669.821855:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+18:15603:x1876403945599360:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 574us (788us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789478669.821863:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 39 00000100:00100000:0.0:1789478669.828726:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478669.829219:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945599616 00000100:00100000:2.0:1789478669.829231:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945599616 00000100:00100000:2.0:1789478669.829293:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00100000:2.0:1789478669.829304:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cca3a112-296c-4f03-abf1-9544e970264f+18:15603:x1876403945599616:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:2.0:1789478669.830445:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cca3a112-296c-4f03-abf1-9544e970264f+19:15603:x1876403945599616:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 1136us (1721us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789478669.830457:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00100000:1.0:1789478669.864012:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478669.864434:0:18465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945599872 00000100:00100000:3.0:1789478669.864444:0:18465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945599872 00000100:00100000:3.0:1789478669.864501:0:18465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 40 00000100:00100000:3.0:1789478669.864512:0:18465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca3a112-296c-4f03-abf1-9544e970264f+19:15606:x1876403945599872:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1789478669.864547:0:18465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478669.864567:0:18465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66400/0x8ebaae74e82175cf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b77d2 expref: -99 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.865269:0:18465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e82175d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.865285:0:18465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e82175d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.865296:0:18465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e82175d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478669.865308:0:18465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789478669.865414:0:18465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66400/0x8ebaae74e82175cf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77d2 expref: 22 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.865448:0:18465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e82175d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77d2 expref: 21 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.865458:0:18465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ebb02552600) 00010000:00010000:3.0:1789478669.865461:0:18465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789478669.865464:0:18465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b66e00, rc 0) 00000100:00100000:3.0:1789478669.865522:0:18465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca3a112-296c-4f03-abf1-9544e970264f+21:15606:x1876403945599872:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 1012us (1517us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789478669.865539:0:18465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 40 00000100:00100000:0.0:1789478669.874881:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478669.874933:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478669.875025:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945600128 00000100:00100000:3.0:1789478669.875042:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945600128 00000100:00100000:3.0:1789478669.875103:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 41 00000100:00100000:3.0:1789478669.875113:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca3a112-296c-4f03-abf1-9544e970264f+21:15606:x1876403945600128:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:3.0:1789478669.875181:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e82175e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.875196:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e82175e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.875207:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e82175e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.875239:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e82175e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.875246:0:17239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e82175e4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.875266:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e82175e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.875271:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b66800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:3.0:1789478669.875276:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e82175e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.875283:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e82175e4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.875296:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ebb02552600) 00010000:00010000:3.0:1789478669.875299:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789478669.875303:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e82175e4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478669.875310:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e82175e4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478669.875373:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca3a112-296c-4f03-abf1-9544e970264f+21:15606:x1876403945600128:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 261us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478669.875380:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 41 00000100:00100000:2.0:1789478669.877668:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945600000 00000100:00100000:2.0:1789478669.877682:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945600000 00000100:00100000:2.0:1789478669.877754:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:2.0:1789478669.877764:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cca3a112-296c-4f03-abf1-9544e970264f+21:2396:x1876403945600000:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789478669.877778:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478669.877799:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66e00/0x8ebaae74e82175d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77d2 expref: 21 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478669.877819:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ebb02552600) 00010000:00010000:2.0:1789478669.877824:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478669.877885:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cca3a112-296c-4f03-abf1-9544e970264f+20:2396:x1876403945600000:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 123us (3013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478669.877892:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:0.0:1789478669.882859:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478669.882950:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945600384 00000100:00100000:2.0:1789478669.882959:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945600384 00000100:00100000:2.0:1789478669.883011:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:2.0:1789478669.883021:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cca3a112-296c-4f03-abf1-9544e970264f+20:15606:x1876403945600384:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:2.0:1789478669.883214:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cca3a112-296c-4f03-abf1-9544e970264f+21:15606:x1876403945600384:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 194us (364us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789478669.883222:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:3.0:1789478669.950271:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478669.950317:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478669.950434:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945600512 00000100:00100000:0.0:1789478669.950444:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945600512 00000100:00100000:0.0:1789478669.950507:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 163 00000100:00100000:0.0:1789478669.950519:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+13:2397:x1876403945600512:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478669.950633:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfa9933-6ffc-43b1-8c4f-3d477dd92578+13:2397:x1876403945600512:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 117us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478669.950641:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 163 00000100:00100000:0.0:1789478669.950955:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478669.950983:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478669.951078:0:18465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945601024 00000100:00100000:3.0:1789478669.951083:0:18465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945601024 00000100:00100000:3.0:1789478669.951128:0:18465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 50 00000100:00100000:3.0:1789478669.951135:0:18465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d59ee182-687f-47d8-811d-4824d67b8550+12:2397:x1876403945601024:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1789478669.951180:0:18465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d59ee182-687f-47d8-811d-4824d67b8550+12:2397:x1876403945601024:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 46us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478669.951200:0:18465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 50 00000100:00100000:0.0:1789478669.958742:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478669.958781:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478669.958848:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945600640 00000100:00100000:2.0:1789478669.958858:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945600640 00000100:00100000:2.0:1789478669.958918:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:2.0:1789478669.958942:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+5:2397:x1876403945600640:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1789478669.959011:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+5:2397:x1876403945600640:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 72us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478669.959019:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:1.0:1789478669.959514:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945600768 00000100:00100000:1.0:1789478669.959520:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945600768 00000100:00100000:1.0:1789478669.959625:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945601280 00000100:00100000:1.0:1789478669.959629:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945601280 00000100:00100000:1.0:1789478669.959649:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:1.0:1789478669.959656:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cca3a112-296c-4f03-abf1-9544e970264f+5:2397:x1876403945600768:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478669.959700:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cca3a112-296c-4f03-abf1-9544e970264f+5:2397:x1876403945600768:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 44us (9382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478669.959707:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:1.0:1789478669.959720:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:1.0:1789478669.959726:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d59ee182-687f-47d8-811d-4824d67b8550+5:2397:x1876403945601280:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1789478669.959746:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d59ee182-687f-47d8-811d-4824d67b8550+5:2397:x1876403945601280:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 21us (8763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478669.959753:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00080000:2.0:1789478669.959800:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789478669.959813:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945600896 00000100:00100000:2.0:1789478669.959817:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945600896 00000100:00100000:2.0:1789478669.959843:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:2.0:1789478669.959850:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cca3a112-296c-4f03-abf1-9544e970264f+5:2397:x1876403945600896:12345-192.168.206.11@tcp:400:kworker.0 00000100:00080000:1.0:1789478669.961288:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789478669.962029:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cca3a112-296c-4f03-abf1-9544e970264f+5:2397:x1876403945600896:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 2172us (3240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478669.962047:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:3.0:1789478669.962832:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478669.962939:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478669.963302:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945601408 00000100:00100000:0.0:1789478669.963311:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945601408 00000100:00100000:0.0:1789478669.963373:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:0.0:1789478669.963382:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d59ee182-687f-47d8-811d-4824d67b8550+5:2397:x1876403945601408:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1789478669.963439:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d59ee182-687f-47d8-811d-4824d67b8550+5:2397:x1876403945601408:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 58us (501us total) trans 0 rc 0/0 00000100:00080000:1.0:1789478669.963563:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789478669.964410:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:2.0:1789478669.965000:0:18465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945601152 00000100:00100000:2.0:1789478669.965008:0:18465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945601152 00000100:00100000:2.0:1789478669.965591:0:18465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:2.0:1789478669.965628:0:18465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d59ee182-687f-47d8-811d-4824d67b8550+5:2397:x1876403945601152:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1789478669.965707:0:18465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d59ee182-687f-47d8-811d-4824d67b8550+5:2397:x1876403945601152:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 83us (2878us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478669.965713:0:18465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 52 00000040:00080000:3.0:1789478669.989501:0:17274:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789478670.218088:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478670.218901:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945601664 00000100:00100000:2.0:1789478670.218912:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945601664 00000100:00100000:2.0:1789478670.218980:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 42 00000100:00100000:2.0:1789478670.218992:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+21:15637:x1876403945601664:12345-192.168.206.11@tcp:101:cat.0 00010000:00010000:2.0:1789478670.219015:0:17238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478670.219035:0:17238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e82175eb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b77d9 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478670.219149:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82175f2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478670.219164:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82175f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478670.219186:0:17238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82175f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478670.219199:0:17238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789478670.219325:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e82175eb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77d9 expref: 24 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478670.219359:0:17238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82175f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77d9 expref: 23 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478670.219370:0:17238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ebb02552600) 00010000:00010000:2.0:1789478670.219373:0:17238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789478670.219377:0:17238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4b400, rc 0) 00000100:00100000:2.0:1789478670.219441:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+23:15637:x1876403945601664:12345-192.168.206.11@tcp:101:cat.0 Request processed in 451us (1361us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789478670.219448:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 42 00000100:00100000:0.0:1789478670.225685:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478670.225730:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478670.225885:0:17991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945602048 00000100:00100000:2.0:1789478670.225894:0:17991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945602048 00000100:00100000:2.0:1789478670.225946:0:17991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 1 00000100:00100000:2.0:1789478670.225955:0:17991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cca3a112-296c-4f03-abf1-9544e970264f+23:2395:x1876403945602048:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789478670.225968:0:17991:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478670.225998:0:17991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82175f2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77d9 expref: 23 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478670.226016:0:17991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ebb02552600) 00010000:00010000:2.0:1789478670.226021:0:17991:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789478670.226063:0:17991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cca3a112-296c-4f03-abf1-9544e970264f+22:2395:x1876403945602048:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 109us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478670.226070:0:17991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 1 00000100:00100000:3.0:1789478670.226391:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945601920 00000100:00100000:3.0:1789478670.226396:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945601920 00000100:00100000:3.0:1789478670.226433:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 8 00000100:00100000:3.0:1789478670.226441:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cca3a112-296c-4f03-abf1-9544e970264f+22:15637:x1876403945601920:12345-192.168.206.11@tcp:35:cat.0 00000100:00100000:3.0:1789478670.227084:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cca3a112-296c-4f03-abf1-9544e970264f+23:15637:x1876403945601920:12345-192.168.206.11@tcp:35:cat.0 Request processed in 642us (1406us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1789478670.227092:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 8 00000100:00100000:0.0:1789478670.306084:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478670.306338:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945602304 00000100:00100000:3.0:1789478670.306348:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945602304 00000100:00100000:3.0:1789478670.306410:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 43 00000100:00100000:3.0:1789478670.306420:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca3a112-296c-4f03-abf1-9544e970264f+23:15643:x1876403945602304:12345-192.168.206.11@tcp:101:dd.0 00010000:00010000:3.0:1789478670.306443:0:17239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478670.306464:0:17239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66400/0x8ebaae74e8217600 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b77e0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478670.306581:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e8217607 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478670.306637:0:17239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67800/0x8ebaae74e82175a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77bd expref: 24 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478670.306656:0:17239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce200/0x8ebaae74e82175ba lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77c4 expref: 24 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478670.306677:0:17239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e8217607 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478670.306719:0:17239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce200/0x8ebaae74e82175ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77c4 expref: 24 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478670.306732:0:17239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce200/0x8ebaae74e82175ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77c4 expref: 24 pid: 17238 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478670.306745:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04485180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17239:1876403964540928:192.168.206.11@tcp:104: 00010000:00010000:3.0:1789478670.307005:0:17239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67800/0x8ebaae74e82175a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77bd expref: 24 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478670.307014:0:17239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67800/0x8ebaae74e82175a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77bd expref: 24 pid: 17239 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478670.307023:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04487100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17239:1876403964541056:192.168.206.11@tcp:104: 00000100:00100000:3.0:1789478670.307116:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05297600 going to sleep for 11 seconds 00000100:00100000:1.0:1789478670.310442:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478670.310480:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478670.310770:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04485180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17239:1876403964540928:192.168.206.11@tcp:104: 00000100:00100000:3.0:1789478670.310785:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04487100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17239:1876403964541056:192.168.206.11@tcp:104: 00010000:00010000:3.0:1789478670.310809:0:17239:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e8217607 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478670.310983:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945602560 00000100:00100000:0.0:1789478670.310991:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945602560 00010000:00010000:0.0:1789478670.311025:0:17225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67800/0x8ebaae74e82175a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77bd expref: 25 pid: 17239 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478670.311070:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945602432 00000100:00100000:0.0:1789478670.311073:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945602432 00010000:00010000:0.0:1789478670.311084:0:17225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce200/0x8ebaae74e82175ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77c4 expref: 26 pid: 17238 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478670.311118:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:0.0:1789478670.311134:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cca3a112-296c-4f03-abf1-9544e970264f+26:2396:x1876403945602560:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478670.311147:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478670.311154:0:17225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67800/0x8ebaae74e82175a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77bd expref: 26 pid: 17239 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478670.311163:0:17225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67800/0x8ebaae74e82175a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77bd expref: 26 pid: 17239 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478670.311184:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67800/0x8ebaae74e82175a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77bd expref: 26 pid: 17239 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478670.311205:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ebb02552600) 00010000:00010000:0.0:1789478670.311210:0:17225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e8217607 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478670.311218:0:17225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e8217607 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478670.311238:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478670.311288:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cca3a112-296c-4f03-abf1-9544e970264f+25:2396:x1876403945602560:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 162us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478670.311296:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:0.0:1789478670.311313:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:0.0:1789478670.311320:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3d628450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cca3a112-296c-4f03-abf1-9544e970264f+24:2396:x1876403945602432:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789478670.311327:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478670.311332:0:17225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce200/0x8ebaae74e82175ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77c4 expref: 24 pid: 17238 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478670.311341:0:17225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce200/0x8ebaae74e82175ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77c4 expref: 24 pid: 17238 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478670.311354:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce200/0x8ebaae74e82175ba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77c4 expref: 24 pid: 17238 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478670.311364:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ebb02552600) 00010000:00010000:0.0:1789478670.311367:0:17225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e8217607 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478670.311375:0:17225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e8217607 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478670.311386:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e8217607 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478670.311406:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478670.311431:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3d628450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cca3a112-296c-4f03-abf1-9544e970264f+23:2396:x1876403945602432:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 112us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478670.311438:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 18 00010000:00010000:3.0:1789478670.312337:0:17239:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e8217607 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478670.312360:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e8217607 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789478670.312378:0:17239:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789478670.312515:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66400/0x8ebaae74e8217600 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77e0 expref: 24 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478670.312543:0:17239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66800/0x8ebaae74e8217607 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77e0 expref: 23 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478670.312552:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ebb02552600) 00010000:00010000:3.0:1789478670.312554:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789478670.312557:0:17239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b66800, rc 0) 00000100:00100000:3.0:1789478670.312635:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca3a112-296c-4f03-abf1-9544e970264f+23:15643:x1876403945602304:12345-192.168.206.11@tcp:101:dd.0 Request processed in 6216us (6560us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789478670.313632:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 43 00000100:00100000:1.0:1789478670.316712:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478670.317300:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945602688 00000100:00100000:2.0:1789478670.317310:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945602688 00000100:00100000:2.0:1789478670.317368:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 44 00000100:00100000:2.0:1789478670.317377:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+23:15643:x1876403945602688:12345-192.168.206.11@tcp:101:dd.0 00010000:00010000:2.0:1789478670.317399:0:17238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478670.317418:0:17238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8217615 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b77e7 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478670.317449:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e821761c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478670.317462:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e821761c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478670.317472:0:17238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e821761c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478670.319353:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8217615 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77e7 expref: 25 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478670.319379:0:17238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e821761c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77e7 expref: 24 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478670.319403:0:17238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ebb02552600) 00010000:00010000:2.0:1789478670.319406:0:17238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789478670.319409:0:17238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4ac00, rc 0) 00000100:00100000:2.0:1789478670.319479:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+24:15643:x1876403945602688:12345-192.168.206.11@tcp:101:dd.0 Request processed in 2102us (2783us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478670.319487:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 44 00000100:00100000:2.0:1789478670.326050:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478670.326350:0:18465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945602944 00000100:00100000:3.0:1789478670.326359:0:18465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945602944 00000100:00100000:3.0:1789478670.326417:0:18465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 45 00000100:00100000:3.0:1789478670.326427:0:18465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca3a112-296c-4f03-abf1-9544e970264f+24:15643:x1876403945602944:12345-192.168.206.11@tcp:36:dd.0 00010000:00010000:3.0:1789478670.327081:0:18465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66600/0x8ebaae74e8217623 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478670.327111:0:18465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66600/0x8ebaae74e8217623 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478670.327123:0:18465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66600/0x8ebaae74e8217623 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789478670.327194:0:18465:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1789478670.327218:0:18465:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015f58739 reply state 000000003bbcdaa6 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66600/0x8ebaae74e8217623 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478670.327230:0:18465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66600/0x8ebaae74e8217623 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478670.327237:0:18465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ebb02552600) 00010000:00010000:3.0:1789478670.327239:0:18465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789478670.327243:0:18465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789478670.327333:0:18465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca3a112-296c-4f03-abf1-9544e970264f+27:15643:x1876403945602944:12345-192.168.206.11@tcp:36:dd.0 Request processed in 906us (1290us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1789478670.327341:0:18465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 45 00000020:00080000:3.0:1789478670.327346:0:18465:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789478670.332885:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478670.333584:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945603072 00000100:00100000:2.0:1789478670.333631:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945603072 00000100:00100000:2.0:1789478670.334009:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 46 00000100:00100000:2.0:1789478670.334019:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+27:15643:x1876403945603072:12345-192.168.206.11@tcp:101:dd.0 00010000:00010000:2.0:1789478670.334040:0:17238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478670.334059:0:17238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e821762a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b77ee expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478670.334113:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e821762a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77ee expref: 28 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478670.334255:0:17238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e821762a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77ee expref: 28 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478670.334277:0:17238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ebb02552600) 00010000:00010000:2.0:1789478670.334281:0:17238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789478670.334284:0:17238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4b800, rc 0) 00000100:00100000:2.0:1789478670.334348:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+28:15643:x1876403945603072:12345-192.168.206.11@tcp:101:dd.0 Request processed in 330us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478670.334369:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 46 00000100:00100000:1.0:1789478670.355578:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478670.355927:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945603328 00000100:00100000:0.0:1789478670.355937:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945603328 00000100:00100000:0.0:1789478670.356001:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 2 00000100:00100000:0.0:1789478670.356012:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cca3a112-296c-4f03-abf1-9544e970264f+28:15643:x1876403945603328:12345-192.168.206.11@tcp:103:dd.0 00010000:00010000:0.0:1789478670.356038:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478670.356063:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e821762a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77ee expref: 28 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478670.356081:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ebb02552600) 00010000:00010000:0.0:1789478670.356086:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789478670.356147:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cca3a112-296c-4f03-abf1-9544e970264f+27:15643:x1876403945603328:12345-192.168.206.11@tcp:103:dd.0 Request processed in 136us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478670.356154:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 2 00000100:00100000:0.0:1789478670.358940:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478670.359077:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945603456 00000100:00100000:3.0:1789478670.359087:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945603456 00000100:00100000:3.0:1789478670.359197:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 47 00000100:00100000:3.0:1789478670.359208:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca3a112-296c-4f03-abf1-9544e970264f+27:15643:x1876403945603456:12345-192.168.206.11@tcp:58:dd.0 00010000:00010000:3.0:1789478670.359304:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66400/0x8ebaae74e8217631 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478670.359322:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66400/0x8ebaae74e8217631 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478670.359333:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66400/0x8ebaae74e8217631 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789478670.361082:0:17239:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789478670.361145:0:17239:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1789478670.361264:0:17239:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1789478670.361364:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca3a112-296c-4f03-abf1-9544e970264f+27:15643:x1876403945603456:12345-192.168.206.11@tcp:58:dd.0 Request processed in 2153us (2428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478670.361375:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 47 00000100:00100000:0.0:1789478670.368933:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478670.373858:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945603584 00000100:00100000:2.0:1789478670.373872:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945603584 00000100:00100000:2.0:1789478670.373953:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 48 00000100:00100000:2.0:1789478670.373963:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+27:15643:x1876403945603584:12345-192.168.206.11@tcp:101:dd.0 00010000:00010000:2.0:1789478670.373983:0:17240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478670.374004:0:17240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8217638 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b77f5 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478670.374491:0:17240:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66400/0x8ebaae74e8217631 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478670.374505:0:17240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8217638 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77f5 expref: 28 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478670.374524:0:17240:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66400/0x8ebaae74e8217631 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478670.374550:0:17240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8217638 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77f5 expref: 28 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478670.374562:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ebb02552600) 00010000:00010000:2.0:1789478670.374565:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789478670.374569:0:17240:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8217638 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77f5 expref: 28 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478670.374575:0:17240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4b800, rc 0) 00000100:00100000:2.0:1789478670.374873:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+28:15643:x1876403945603584:12345-192.168.206.11@tcp:101:dd.0 Request processed in 911us (5948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478670.374881:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 48 00010000:00010000:1.0:1789478670.569427:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789478671.012801:0:17274:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789478671.012811:0:17274:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789478671.012837:0:17274:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789478671.012846:0:17274:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789478671.012972:0:17274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04485180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17274:1876403964541184:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789478671.013059:0:17274:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc05297a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789478671.018656:0:17274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04485180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17274:1876403964541184:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789478671.029866:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478671.029963:0:18465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945603712 00000100:00100000:0.0:1789478671.029973:0:18465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945603712 00000100:00100000:0.0:1789478671.030266:0:18465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 49 00000100:00100000:0.0:1789478671.030279:0:18465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca3a112-296c-4f03-abf1-9544e970264f+28:15644:x1876403945603712:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789478671.030309:0:18465:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789478671.030534:0:18465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca3a112-296c-4f03-abf1-9544e970264f+28:15644:x1876403945603712:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 248us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478671.030543:0:18465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 49 00000100:00080000:1.0:1789478671.030618:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789478671.040826:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478671.040931:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945603840 00000100:00100000:1.0:1789478671.040940:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945603840 00000100:00100000:1.0:1789478671.041001:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 50 00000100:00100000:1.0:1789478671.041012:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+28:15644:x1876403945603840:12345-192.168.206.11@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789478671.041078:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e821763f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.041093:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e821763f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.041370:0:17238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e821763f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.041459:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8217646 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.041468:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8217646 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.041474:0:17238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8217646 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.041495:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e821764d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.041520:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e821764d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.041537:0:17238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e821764d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789478671.041589:0:17238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789478671.041627:0:17238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789478671.041639:0:17238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e821764d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.041649:0:17238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e821763f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.041656:0:17238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e821763f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.041662:0:17238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e821763f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.041668:0:17238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcf200 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478671.041672:0:17238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e821763f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.041680:0:17238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e821763f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.041691:0:17238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ebc34e09700) 00010000:00010000:1.0:1789478671.041694:0:17238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478671.041698:0:17238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e821763f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.041715:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf200/0x8ebaae74e821763f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.041728:0:17238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8217646 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.041735:0:17238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8217646 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.041740:0:17238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8217646 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.041745:0:17238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcea00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478671.041748:0:17238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8217646 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.041754:0:17238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8217646 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.045007:0:17238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8ebc3523b500) 00010000:00010000:1.0:1789478671.045011:0:17238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478671.045018:0:17238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8217646 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.045026:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e8217646 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.045051:0:17238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e821764d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.045056:0:17238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e821764d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.045076:0:17238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e821764d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.045082:0:17238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fce600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478671.045085:0:17238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e821764d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.045092:0:17238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e821764d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.045101:0:17238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ebb02552600) 00010000:00010000:1.0:1789478671.045104:0:17238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789478671.045107:0:17238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e821764d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.045112:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fce600/0x8ebaae74e821764d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478671.045367:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+28:15644:x1876403945603840:12345-192.168.206.11@tcp:34:lhsmtool_posix.0 Request processed in 4352us (4545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478671.045377:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 50 00000100:00100000:2.0:1789478671.058968:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478671.059209:0:18465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945604096 00000100:00100000:0.0:1789478671.059219:0:18465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945604096 00000100:00100000:0.0:1789478671.059277:0:18465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:0.0:1789478671.059287:0:18465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb044b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca3a112-296c-4f03-abf1-9544e970264f+28:15644:x1876403945604096:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789478671.059304:0:18465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478671.059410:0:18465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05200/0x8ebaae74e8217654 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b77fc expref: -99 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.059535:0:18465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05800/0x8ebaae74e821765b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.059551:0:18465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05800/0x8ebaae74e821765b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.059561:0:18465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05800/0x8ebaae74e821765b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789478671.059572:0:18465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789478671.059673:0:18465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05800/0x8ebaae74e821765b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.059680:0:18465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05800/0x8ebaae74e821765b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.059686:0:18465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05800/0x8ebaae74e821765b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.059703:0:18465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40f05800 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478671.059707:0:18465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05800/0x8ebaae74e821765b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.059730:0:18465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05800/0x8ebaae74e821765b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.059743:0:18465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ebb02552600) 00010000:00010000:0.0:1789478671.059746:0:18465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789478671.059751:0:18465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05800/0x8ebaae74e821765b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.059756:0:18465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05800/0x8ebaae74e821765b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.060195:0:18465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05200/0x8ebaae74e8217654 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77fc expref: 30 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.060206:0:18465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ebc34e09700) 00010000:00010000:0.0:1789478671.060209:0:18465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789478671.060213:0:18465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05200/0x8ebaae74e8217654 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77fc expref: 30 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.060222:0:18465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40f05200, rc 0) 00000100:00100000:0.0:1789478671.061152:0:18465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb044b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca3a112-296c-4f03-abf1-9544e970264f+29:15644:x1876403945604096:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 1861us (2186us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1789478671.061161:0:18465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:0.0:1789478671.077712:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964541312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789478671.077795:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478671.078353:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964541312 00000100:00100000:3.0:1789478671.078362:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964541312 00000100:00100000:3.0:1789478671.078431:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789478671.078451:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964541312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789478671.078479:0:18750:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789478671.078537:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964541312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478671.078544:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1789478671.078898:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789478671.079317:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964541312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789478671.087489:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478671.087803:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945604224 00000100:00100000:2.0:1789478671.087812:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945604224 00000100:00100000:2.0:1789478671.087865:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:2.0:1789478671.087874:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+29:15644:x1876403945604224:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789478671.087905:0:17240:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789478671.088020:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+29:15644:x1876403945604224:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 146us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478671.088087:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:0.0:1789478671.091222:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478671.091471:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945604480 00000100:00100000:3.0:1789478671.091481:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945604480 00000100:00100000:3.0:1789478671.091546:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 53 00000100:00100000:3.0:1789478671.091557:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca3a112-296c-4f03-abf1-9544e970264f+29:15644:x1876403945604480:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789478671.091576:0:17239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789478671.091619:0:17239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e8217669 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7803 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789478671.092007:0:17239:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:3.0:1789478671.092015:0:17239:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:3.0:1789478671.092042:0:17239:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:3.0:1789478671.092241:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e8217670 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478671.092255:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e8217670 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478671.092266:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e8217670 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478671.092320:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e8217669 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7803 expref: 32 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478671.092349:0:17239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e8217670 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7803 expref: 31 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478671.092358:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ebb02552e00) 00010000:00010000:3.0:1789478671.092361:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789478671.092364:0:17239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc35b67a00, rc 0) 00000100:00100000:3.0:1789478671.092417:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca3a112-296c-4f03-abf1-9544e970264f+31:15644:x1876403945604480:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 862us (1723us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1789478671.092424:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 53 00000100:00100000:3.0:1789478671.105940:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478671.106133:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945604736 00000100:00100000:2.0:1789478671.106143:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945604736 00000100:00100000:2.0:1789478671.106201:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 54 00000100:00100000:2.0:1789478671.106210:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+31:15644:x1876403945604736:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789478671.106260:0:17240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789478671.106285:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67a00/0x8ebaae74e8217670 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7803 expref: 31 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.106304:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ebb02552e00) 00010000:00010000:2.0:1789478671.106314:0:17240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789478671.106410:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e821767e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.106425:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e821767e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.106516:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e821767e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.106543:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e8217685 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x38eac639 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.106551:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e8217685 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x38eac639 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.106558:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e8217685 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x38eac639 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.106646:0:17240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e821767e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.106654:0:17240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e821767e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.106661:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e821767e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.106667:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4b200 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478671.106671:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e821767e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.106678:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e821767e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.106687:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ebc3523b400) 00010000:00010000:2.0:1789478671.106690:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478671.106694:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e821767e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.106706:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e821767e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.106716:0:17240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e8217685 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x38eac639 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.106722:0:17240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e8217685 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x38eac639 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.106728:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e8217685 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x38eac639 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.106733:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4a200 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478671.106736:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e8217685 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x38eac639 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.106741:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e8217685 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x38eac639 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.106748:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x38eac639 (ffff8ebc34e09c00) 00010000:00010000:2.0:1789478671.106750:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478671.106753:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e8217685 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x38eac639 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.106759:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4a200/0x8ebaae74e8217685 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x38eac639 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478671.107243:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+30:15644:x1876403945604736:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 1030us (1307us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789478671.107252:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 54 00000100:00100000:2.0:1789478671.112511:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478671.112591:0:18465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945604864 00000100:00100000:0.0:1789478671.112630:0:18465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945604864 00000100:00100000:0.0:1789478671.112687:0:18465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 55 00000100:00100000:0.0:1789478671.112705:0:18465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca3a112-296c-4f03-abf1-9544e970264f+30:15644:x1876403945604864:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789478671.112723:0:18465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478671.112745:0:18465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05800/0x8ebaae74e821768c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b780a expref: -99 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.112787:0:18465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05200/0x8ebaae74e8217693 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.112800:0:18465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05200/0x8ebaae74e8217693 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.112811:0:18465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05200/0x8ebaae74e8217693 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.112908:0:18465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05800/0x8ebaae74e821768c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b780a expref: 32 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.112925:0:18465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05200/0x8ebaae74e8217693 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b780a expref: 31 pid: 18465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.112932:0:18465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ebc07dd1b00) 00010000:00010000:0.0:1789478671.112935:0:18465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789478671.112938:0:18465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40f05200, rc 0) 00000100:00100000:0.0:1789478671.113261:0:18465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca3a112-296c-4f03-abf1-9544e970264f+31:15644:x1876403945604864:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 564us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478671.113278:0:18465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 55 00000100:00100000:0.0:1789478671.123903:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478671.124100:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945605120 00000100:00100000:3.0:1789478671.124109:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945605120 00000100:00100000:3.0:1789478671.124176:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 56 00000100:00100000:3.0:1789478671.124187:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca3a112-296c-4f03-abf1-9544e970264f+31:15644:x1876403945605120:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789478671.124256:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821769a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478671.124274:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821769a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478671.124285:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821769a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789478671.124462:0:17239:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1789478671.124472:0:17239:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 500239877831ns, next at 501239875514ns, rc = 0 00000004:00010000:3.0:1789478671.124518:0:17239:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000321486ab reply state 00000000d4c56443 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821769a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478671.124542:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821769a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478671.124550:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ebc07dd1b00) 00010000:00010000:3.0:1789478671.124553:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789478671.124556:0:17239:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789478671.125068:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca3a112-296c-4f03-abf1-9544e970264f+33:15644:x1876403945605120:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 805us (1096us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1789478671.125076:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 56 00000100:00100000:3.0:1789478671.128303:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478671.128410:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945605248 00000100:00100000:1.0:1789478671.128420:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945605248 00000100:00100000:1.0:1789478671.128485:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:1.0:1789478671.128495:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb04485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+33:15644:x1876403945605248:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789478671.128517:0:17238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789478671.128555:0:17238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82176a1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7811 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.128666:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82176a1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7811 expref: 34 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.128679:0:17238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82176a1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7811 expref: 34 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.128697:0:17238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ebc07dd1b00) 00010000:00010000:1.0:1789478671.128701:0:17238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789478671.128704:0:17238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40fcea00, rc 0) 00000100:00100000:1.0:1789478671.128772:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb04485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+34:15644:x1876403945605248:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 278us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478671.128779:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:0.0:1789478671.135972:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478671.136326:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945605376 00000100:00100000:1.0:1789478671.136336:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945605376 00000100:00100000:1.0:1789478671.136471:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:1.0:1789478671.136482:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cca3a112-296c-4f03-abf1-9544e970264f+5:2396:x1876403945605376:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789478671.136768:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cca3a112-296c-4f03-abf1-9544e970264f+6:2396:x1876403945605376:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 Request processed in 280us (796us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789478671.136776:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:0.0:1789478671.141407:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478671.141562:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945605632 00000100:00100000:3.0:1789478671.141571:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945605632 00000100:00100000:3.0:1789478671.141653:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:3.0:1789478671.141663:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cca3a112-296c-4f03-abf1-9544e970264f+34:15644:x1876403945605632:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789478671.141885:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cca3a112-296c-4f03-abf1-9544e970264f+35:15644:x1876403945605632:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 223us (485us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1789478671.141893:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00080000:2.0:1789478671.143884:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789478671.147499:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478671.147654:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945605888 00000100:00100000:3.0:1789478671.147663:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945605888 00000100:00100000:3.0:1789478671.147722:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00100000:3.0:1789478671.147732:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb037af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca3a112-296c-4f03-abf1-9544e970264f+35:15644:x1876403945605888:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789478671.147865:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb037af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca3a112-296c-4f03-abf1-9544e970264f+35:15644:x1876403945605888:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 134us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478671.147874:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00100000:1.0:1789478671.149726:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478671.149876:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945606016 00000100:00100000:2.0:1789478671.149884:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945606016 00000100:00100000:2.0:1789478671.149934:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 59 00000100:00100000:2.0:1789478671.149944:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+35:15644:x1876403945606016:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789478671.149961:0:17238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478671.149981:0:17238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e82176a8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7818 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.150074:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176af lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.150088:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.150097:0:17238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789478671.150138:0:17238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789478671.150166:0:17238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.150191:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b200/0x8ebaae74e82176a8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7818 expref: 37 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.150226:0:17238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7818 expref: 36 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.150235:0:17238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ebc07dd1b00) 00010000:00010000:2.0:1789478671.150246:0:17238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789478671.150249:0:17238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4b400, rc 0) 00000100:00100000:2.0:1789478671.150303:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+36:15644:x1876403945606016:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 360us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478671.150310:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 59 00000100:00100000:0.0:1789478671.152833:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478671.153929:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945606144 00000100:00100000:2.0:1789478671.153939:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945606144 00000100:00100000:2.0:1789478671.153989:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:2.0:1789478671.153999:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cca3a112-296c-4f03-abf1-9544e970264f+6:2396:x1876403945606144:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789478671.154014:0:19739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789478671.154047:0:19739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9211d06/0x8ebaae74e82176b6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b781f expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789478671.154071:0:19739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9470e, blocks: 0x0 00010000:00010000:2.0:1789478671.154087:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1789478671.154092:0:19739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478671.154101:0:19739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9211d06/0x8ebaae74e82176b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b781f expref: 7 pid: 19739 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.154118:0:19739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c9211d06/0x8ebaae74e82176b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b781f expref: 7 pid: 19739 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.154131:0:19739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc08c4a200, rc 0) 00000100:00100000:2.0:1789478671.154305:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cca3a112-296c-4f03-abf1-9544e970264f+7:2396:x1876403945606144:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 307us (1480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478671.154312:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:1.0:1789478671.169558:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478671.173851:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945606400 00000100:00100000:3.0:1789478671.173867:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945606400 00000100:00100000:2.0:1789478671.176264:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 60 00000100:00100000:2.0:1789478671.176278:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca3a112-296c-4f03-abf1-9544e970264f+36:15644:x1876403945606400:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789478671.176748:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca3a112-296c-4f03-abf1-9544e970264f+36:15644:x1876403945606400:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 471us (7196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478671.176769:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 60 00000100:00100000:1.0:1789478671.180952:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1789478671.181053:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945606528 00000100:00100000:2.0:1789478671.181062:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945606528 00000100:00100000:2.0:1789478671.181118:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 61 00000100:00100000:2.0:1789478671.181137:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+36:15644:x1876403945606528:12345-192.168.206.11@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789478671.184765:0:17219:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1789478671.184780:0:17219:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1789478671.184828:0:17219:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1789478671.184963:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca3a112-296c-4f03-abf1-9544e970264f+19:15644:x1876403945606528:12345-192.168.206.11@tcp:44:lhsmtool_posix.0 Request processed in 3831us (4014us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478671.184973:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 61 00010000:00010000:0.0:1789478671.185625:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217543 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.185637:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217543 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.185643:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217543 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.185650:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4aa00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478671.185653:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217543 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.185660:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217543 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.185674:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ebc3523b400) 00010000:00010000:0.0:1789478671.185677:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789478671.185682:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217543 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.185689:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4aa00/0x8ebaae74e8217543 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478671.185725:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789478671.185740:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964541440:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789478671.185802:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789478671.186410:0:19341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964541440 00000100:00100000:3.0:1789478671.186418:0:19341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964541440 00000100:00100000:3.0:1789478671.186491:0:19341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789478671.186501:0:19341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964541440:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789478671.186651:0:19341:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789478671.186654:0:19341:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1789478671.186657:0:19341:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789478671.186658:0:19341:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789478670 -> 1789478670 00002000:00010000:3.0:1789478671.186661:0:19341:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789478671.186705:0:19341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1876403964541440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 205us (903us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789478671.186711:0:19341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1789478671.187462:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789478671.187657:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ebb04484000/2, rc 0, transno 8589934596 00000100:00100000:0.0:1789478671.187665:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964541440:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789478671.191795:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1789478671.191926:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945606656 00000100:00100000:1.0:1789478671.191936:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945606656 00000100:00100000:1.0:1789478671.191988:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 23 00000100:00100000:1.0:1789478671.192011:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc05acdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cca3a112-296c-4f03-abf1-9544e970264f+7:2397:x1876403945606656:12345-192.168.206.11@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789478671.192118:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc05acdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cca3a112-296c-4f03-abf1-9544e970264f+7:2397:x1876403945606656:12345-192.168.206.11@tcp:16:lhsmtool_posix.0 Request processed in 108us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478671.192125:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 23 00010000:00010000:0.0:1789478671.194289:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82174ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194307:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82174ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194315:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82174ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194321:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfc00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478671.194325:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82174ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194333:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82174ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194349:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ebc3523b700) 00010000:00010000:0.0:1789478671.194353:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478671.194357:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82174ef lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194362:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfc00/0x8ebaae74e82174ef lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194395:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82174f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194403:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82174f6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194408:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82174f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194413:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcfe00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478671.194416:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82174f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194423:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82174f6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194431:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ebc3523b400) 00010000:00010000:0.0:1789478671.194434:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478671.194437:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82174f6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194441:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcfe00/0x8ebaae74e82174f6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194455:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66000/0x8ebaae74e821759e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194461:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66000/0x8ebaae74e821759e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194466:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66000/0x8ebaae74e821759e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194477:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b66000 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478671.194480:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66000/0x8ebaae74e821759e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194487:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66000/0x8ebaae74e821759e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194496:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8ebb02552500) 00010000:00010000:0.0:1789478671.194498:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478671.194501:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66000/0x8ebaae74e821759e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194508:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66000/0x8ebaae74e821759e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194535:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66600/0x8ebaae74e8217623 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194542:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66600/0x8ebaae74e8217623 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194546:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66600/0x8ebaae74e8217623 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194551:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b66600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478671.194554:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66600/0x8ebaae74e8217623 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194559:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66600/0x8ebaae74e8217623 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194576:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ebb02552600) 00010000:00010000:0.0:1789478671.194579:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789478671.194583:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66600/0x8ebaae74e8217623 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194588:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66600/0x8ebaae74e8217623 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194615:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821769a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194623:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821769a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194627:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821769a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194632:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b67e00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:0.0:1789478671.194634:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821769a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194640:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821769a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194646:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ebc07dd1b00) 00010000:00010000:0.0:1789478671.194648:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789478671.194651:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821769a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.194655:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b67e00/0x8ebaae74e821769a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478671.201060:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478671.201141:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945606912 00000100:00100000:0.0:1789478671.201149:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945606912 00000100:00100000:0.0:1789478671.201214:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 62 00000100:00100000:0.0:1789478671.201224:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+15:15644:x1876403945606912:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789478671.201272:0:17240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789478671.201299:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176af lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7818 expref: 15 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.201318:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ebc07dd1b00) 00010000:00010000:0.0:1789478671.201323:0:17240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789478671.201350:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05a00/0x8ebaae74e82176bd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.201363:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05a00/0x8ebaae74e82176bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.201372:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05a00/0x8ebaae74e82176bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789478671.201486:0:17240:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059518de3 reply state 0000000030258a1d transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05a00/0x8ebaae74e82176bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.201498:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05a00/0x8ebaae74e82176bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.201504:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ebc07dd1b00) 00010000:00010000:0.0:1789478671.201507:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789478671.201510:0:17240:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789478671.201655:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+16:15644:x1876403945606912:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 431us (602us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1789478671.201670:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 62 00000100:00100000:1.0:1789478671.204978:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478671.205142:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945607040 00000100:00100000:0.0:1789478671.205158:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945607040 00000100:00100000:0.0:1789478671.205226:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:0.0:1789478671.205236:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cca3a112-296c-4f03-abf1-9544e970264f+7:2396:x1876403945607040:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789478671.205368:0:18746:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789478671.205372:0:18746:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789478669 00002000:00010000:0.0:1789478671.205375:0:18746:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789478669 00002000:00010000:0.0:1789478671.205378:0:18746:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789478670 -> 1789478669 00002000:00010000:0.0:1789478671.205380:0:18746:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789478671.205567:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cca3a112-296c-4f03-abf1-9544e970264f+8:2396:x1876403945607040:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 Request processed in 331us (595us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789478671.205575:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:2.0:1789478671.216138:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478671.216281:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945607168 00000100:00100000:0.0:1789478671.216291:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945607168 00000100:00100000:0.0:1789478671.216335:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:0.0:1789478671.216344:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cca3a112-296c-4f03-abf1-9544e970264f+8:2398:x1876403945607168:12345-192.168.206.11@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789478671.216386:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dc751f79/0x8ebaae74e82176c4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.216401:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478671.216406:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478671.216411:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc751f79/0x8ebaae74e82176c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.216424:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc751f79/0x8ebaae74e82176c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.216459:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dc751f79/0x8ebaae74e82176c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.216466:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc751f79/0x8ebaae74e82176c4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.216474:0:18747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc751f79/0x8ebaae74e82176c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.216480:0:18747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40f05600 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:0.0:1789478671.216484:0:18747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc751f79/0x8ebaae74e82176c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.216492:0:18747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc751f79/0x8ebaae74e82176c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.216506:0:18747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc751f79/0x8ebaae74e82176c4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.216514:0:18747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc751f79/0x8ebaae74e82176c4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478671.216625:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cca3a112-296c-4f03-abf1-9544e970264f+8:2398:x1876403945607168:12345-192.168.206.11@tcp:1:lhsmtool_posix.0 Request processed in 281us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478671.216642:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:1.0:1789478671.218857:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478671.219073:0:18465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945607424 00000100:00100000:0.0:1789478671.219082:0:18465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945607424 00000100:00100000:0.0:1789478671.219342:0:18465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 63 00000100:00100000:0.0:1789478671.219357:0:18465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca3a112-296c-4f03-abf1-9544e970264f+16:15644:x1876403945607424:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789478671.219431:0:18465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f04c00/0x8ebaae74e82176cb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.219447:0:18465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e821761c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77e7 expref: 16 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.219456:0:18465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f04c00/0x8ebaae74e82176cb lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.219488:0:18465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e821761c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77e7 expref: 16 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.219501:0:18465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e821761c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77e7 expref: 16 pid: 17238 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478671.219515:0:18465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08885f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18465:1876403964541568:192.168.206.11@tcp:104: 00000100:00100000:0.0:1789478671.219634:0:18465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc0636d900 going to sleep for 11 seconds 00000100:00100000:0.0:1789478671.222317:0:18465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08885f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18465:1876403964541568:192.168.206.11@tcp:104: 00010000:00010000:0.0:1789478671.222346:0:18465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f04c00/0x8ebaae74e82176cb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478671.228660:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478671.229680:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945607552 00000100:00100000:3.0:1789478671.229703:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945607552 00010000:00010000:3.0:1789478671.229743:0:17224:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e821761c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77e7 expref: 17 pid: 17238 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478671.229889:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:3.0:1789478671.229900:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cca3a112-296c-4f03-abf1-9544e970264f+17:2395:x1876403945607552:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789478671.229915:0:17224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478671.229922:0:17224:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e821761c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77e7 expref: 17 pid: 17238 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478671.229935:0:17224:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e821761c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77e7 expref: 17 pid: 17238 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478671.229956:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4ac00/0x8ebaae74e821761c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77e7 expref: 17 pid: 17238 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478671.229970:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ebb02552600) 00010000:00010000:3.0:1789478671.229975:0:17224:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8217638 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77f5 expref: 16 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478671.229984:0:17224:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f04c00/0x8ebaae74e82176cb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478671.229990:0:17224:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f04c00/0x8ebaae74e82176cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478671.229996:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f04c00/0x8ebaae74e82176cb lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478671.230155:0:17224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478671.230218:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cca3a112-296c-4f03-abf1-9544e970264f+16:2395:x1876403945607552:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 306us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478671.230226:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 19 00010000:00010000:0.0:1789478671.232512:0:18465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f04c00/0x8ebaae74e82176cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.232547:0:18465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f04c00/0x8ebaae74e82176cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.232980:0:18465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82176d2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.232996:0:18465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82176a1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7811 expref: 16 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.233005:0:18465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82176d2 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.233110:0:18465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82176a1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7811 expref: 16 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.233359:0:18465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82176a1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7811 expref: 16 pid: 17238 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478671.233376:0:18465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18465:1876403964541696:192.168.206.11@tcp:104: 00000100:00100000:1.0:1789478671.233495:0:18465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc40dfcd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789478671.240715:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478671.240933:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945607680 00000100:00100000:0.0:1789478671.240942:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945607680 00010000:00010000:0.0:1789478671.240989:0:17225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82176a1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7811 expref: 17 pid: 17238 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478671.241114:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:1.0:1789478671.241138:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c963480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cca3a112-296c-4f03-abf1-9544e970264f+17:2396:x1876403945607680:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789478671.241159:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789478671.241179:0:17225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82176a1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7811 expref: 17 pid: 17238 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.241194:0:17225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82176a1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7811 expref: 17 pid: 17238 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.241226:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ebc07dd1b00) 00010000:00010000:1.0:1789478671.241231:0:17225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82176d2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.241239:0:17225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82176d2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.241245:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82176d2 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.241263:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789478671.241319:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c963480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cca3a112-296c-4f03-abf1-9544e970264f+17:2396:x1876403945607680:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 195us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478671.241326:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 20 00010000:00010000:3.0:1789478671.242451:0:18465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcea00/0x8ebaae74e82176a1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7811 expref: 16 pid: 17238 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478671.242473:0:18465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18465:1876403964541696:192.168.206.11@tcp:104: 00010000:00010000:3.0:1789478671.242504:0:18465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82176d2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478671.242514:0:18465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82176d2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478671.242519:0:18465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82176d2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789478671.242659:0:18465:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1789478671.242768:0:18465:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1789478671.243071:0:18465:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1789478671.243152:0:18465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c962300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18465:1876403964541824:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789478671.243203:0:18465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478671.243235:0:18465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc08cff240 going to sleep for 11 seconds 00000100:00100000:3.0:1789478671.243296:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964541824 00000100:00100000:3.0:1789478671.243302:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964541824 00000100:00100000:3.0:1789478671.243343:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789478671.243353:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18465:x1876403964541824:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789478671.243433:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18465:x1876403964541824:12345-0@lo:1000:mdt00_003.0 Request processed in 81us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478671.243441:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789478671.243482:0:18465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c962300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18465:1876403964541824:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1789478671.243656:0:18465:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1789478671.243697:0:18465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18465:1876403964541952:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789478671.243726:0:18465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478671.243754:0:18465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02afbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789478671.243876:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964541952 00000100:00100000:3.0:1789478671.243891:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964541952 00000100:00100000:3.0:1789478671.243923:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789478671.243931:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18465:x1876403964541952:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789478671.244195:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:18465:x1876403964541952:12345-0@lo:1000:mdt00_003.0 Request processed in 264us (467us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1789478671.244210:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789478671.248061:0:18465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18465:1876403964541952:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789478671.248123:0:18465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82176d2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.248151:0:18465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82176d2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.248157:0:18465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82176d2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.248162:0:18465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40fcf600 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478671.248167:0:18465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82176d2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.248173:0:18465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82176d2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.248188:0:18465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ebc07dd1b00) 00010000:00010000:1.0:1789478671.248265:0:18465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789478671.248271:0:18465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82176d2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.248277:0:18465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40fcf600/0x8ebaae74e82176d2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.248307:0:18465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66400/0x8ebaae74e8217631 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.248313:0:18465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66400/0x8ebaae74e8217631 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.248318:0:18465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66400/0x8ebaae74e8217631 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.248322:0:18465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc35b66400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:1.0:1789478671.248331:0:18465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66400/0x8ebaae74e8217631 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.248337:0:18465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66400/0x8ebaae74e8217631 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.248345:0:18465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ebb02552600) 00010000:00010000:1.0:1789478671.248347:0:18465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789478671.248354:0:18465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8217638 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77f5 expref: 19 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.248364:0:18465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8217638 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77f5 expref: 19 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.248372:0:18465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8217638 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77f5 expref: 19 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.248872:0:18465:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b800/0x8ebaae74e8217638 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b77f5 expref: 19 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478671.248887:0:18465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc40ecdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18465:1876403964542080:192.168.206.11@tcp:105: 00000100:00100000:1.0:1789478671.249086:0:18465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc02afb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789478671.256207:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478671.256269:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945607808 00000100:00100000:3.0:1789478671.256279:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945607808 00000100:00100000:3.0:1789478671.256342:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:3.0:1789478671.256353:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08d2f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cca3a112-296c-4f03-abf1-9544e970264f+20:15643:x1876403945607808:12345-192.168.206.11@tcp:49:dd.0 00000100:00100000:2.0:1789478671.256355:0:18465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc40ecdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18465:1876403964542080:192.168.206.11@tcp:105: 00010000:00010000:2.0:1789478671.256384:0:18465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66400/0x8ebaae74e8217631 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.256426:0:18465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc35b66400/0x8ebaae74e8217631 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.256459:0:18465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176d9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.256473:0:18465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176d9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478671.256483:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08d2f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cca3a112-296c-4f03-abf1-9544e970264f+20:15643:x1876403945607808:12345-192.168.206.11@tcp:49:dd.0 Request processed in 131us (290us total) trans 0 rc 0/0 00010000:00010000:2.0:1789478671.256484:0:18465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176d9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478671.256498:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 10 00010000:00010000:2.0:1789478671.256501:0:18465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176d9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.256510:0:18465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176d9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.256517:0:18465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176d9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.256532:0:18465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4b400 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478671.256536:0:18465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176d9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.256543:0:18465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176d9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.256554:0:18465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ebb02552600) 00010000:00010000:2.0:1789478671.256557:0:18465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789478671.256561:0:18465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176d9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.256573:0:18465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176d9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.256584:0:18465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f04c00/0x8ebaae74e82176cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.256590:0:18465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f04c00/0x8ebaae74e82176cb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.256638:0:18465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f04c00/0x8ebaae74e82176cb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.256644:0:18465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40f04c00 already unused, calling callback (ffffffffc19934f0) 00010000:00010000:2.0:1789478671.256647:0:18465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f04c00/0x8ebaae74e82176cb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.256653:0:18465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f04c00/0x8ebaae74e82176cb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.256663:0:18465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ebb02552600) 00010000:00010000:2.0:1789478671.256665:0:18465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789478671.256669:0:18465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f04c00/0x8ebaae74e82176cb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.256675:0:18465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f04c00/0x8ebaae74e82176cb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478671.256802:0:18465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca3a112-296c-4f03-abf1-9544e970264f+19:15644:x1876403945607424:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 37449us (37951us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789478671.256811:0:18465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 63 00000020:00080000:2.0:1789478671.256819:0:18465:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789478671.256971:0:17274:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789478671.256976:0:17274:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789478671.256994:0:17274:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789478671.257000:0:17274:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789478671.261359:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478671.261461:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945608064 00000100:00100000:3.0:1789478671.261471:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945608064 00000100:00100000:3.0:1789478671.261516:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 11 00000100:00100000:3.0:1789478671.261537:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cca3a112-296c-4f03-abf1-9544e970264f+19:15644:x1876403945608064:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789478671.262559:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478671.262624:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945608192 00000100:00100000:0.0:1789478671.262631:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945608192 00000100:00100000:0.0:1789478671.262677:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 64 00000100:00100000:0.0:1789478671.262686:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+20:15643:x1876403945608192:12345-192.168.206.11@tcp:101:dd.0 00010000:00010000:0.0:1789478671.262700:0:17240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789478671.262720:0:17240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f04e00/0x8ebaae74e82176e0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x26cc8ba2255b7826 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.262751:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05800/0x8ebaae74e82176e7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.262764:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05800/0x8ebaae74e82176e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.262785:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05800/0x8ebaae74e82176e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.262885:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f04e00/0x8ebaae74e82176e0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7826 expref: 22 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.262901:0:17240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc40f05800/0x8ebaae74e82176e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b7826 expref: 21 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.262908:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ebb02552600) 00010000:00010000:0.0:1789478671.262911:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789478671.262914:0:17240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ebc40f05800, rc 0) 00000100:00100000:0.0:1789478671.263084:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca3a112-296c-4f03-abf1-9544e970264f+21:15643:x1876403945608192:12345-192.168.206.11@tcp:101:dd.0 Request processed in 397us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478671.263090:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 64 00000004:00080000:2.0:1789478671.263244:0:17242:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789478671.263443:0:17242:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1789478671.263471:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176ee lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.263482:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.263490:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.263497:0:17242:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176ee lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.263502:0:17242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176ee lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.263507:0:17242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.263537:0:17242:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789478671.263558:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789478671.263565:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176ee lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.263572:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4b400 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:1.0:1789478671.263584:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176ee lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.263618:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.263630:0:17227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ebc07dd1b00) 00010000:00010000:1.0:1789478671.263633:0:17227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789478671.263636:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176ee lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.263640:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ebc08c4b400/0x8ebaae74e82176ee lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789478671.263649:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478671.263651:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789478671.263652:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789478671.263908:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cca3a112-296c-4f03-abf1-9544e970264f+22:15644:x1876403945608064:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 2368us (2552us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789478671.263916:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 11 00000020:00080000:2.0:1789478671.263926:0:17242:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789478671.432457:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1789478671.432585:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945608320 00000100:00100000:0.0:1789478671.432618:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945608320 00000100:00100000:0.0:1789478671.432684:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:0.0:1789478671.432694:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cca3a112-296c-4f03-abf1-9544e970264f+8:2397:x1876403945608320:12345-192.168.206.11@tcp:4:dd.0 00010000:00010000:0.0:1789478671.432728:0:18751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1e60ef6/0x8ebaae74e82176f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.432748:0:18751:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9211d06/0x8ebaae74e82176b6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b781f expref: 8 pid: 19739 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.432757:0:18751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478671.432761:0:18751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789478671.432766:0:18751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1e60ef6/0x8ebaae74e82176f5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.432816:0:18751:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c9211d06/0x8ebaae74e82176b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b781f expref: 8 pid: 19739 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.432829:0:18751:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c9211d06/0x8ebaae74e82176b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b781f expref: 8 pid: 19739 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478671.432842:0:18751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08885f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18751:1876403964542208:192.168.206.11@tcp:104: 00000100:00100000:0.0:1789478671.432920:0:18751:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ebc0636d900 going to sleep for 11 seconds 00000100:00100000:1.0:1789478671.436189:0:18751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08885f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18751:1876403964542208:192.168.206.11@tcp:104: 00010000:00010000:1.0:1789478671.436215:0:18751:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e1e60ef6/0x8ebaae74e82176f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478671.436942:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478671.437260:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945608576 00000100:00100000:3.0:1789478671.437268:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945608576 00010000:00010000:3.0:1789478671.437303:0:17224:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c9211d06/0x8ebaae74e82176b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b781f expref: 9 pid: 19739 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789478671.437339:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:3.0:1789478671.437347:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cca3a112-296c-4f03-abf1-9544e970264f+9:2396:x1876403945608576:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789478671.437359:0:17224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789478671.437377:0:17224:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c9211d06/0x8ebaae74e82176b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b781f expref: 9 pid: 19739 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478671.437402:0:17224:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c9211d06/0x8ebaae74e82176b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b781f expref: 9 pid: 19739 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478671.437423:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9211d06/0x8ebaae74e82176b6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x26cc8ba2255b781f expref: 9 pid: 19739 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478671.437439:0:17224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478671.437443:0:17224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789478671.437448:0:17224:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1e60ef6/0x8ebaae74e82176f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478671.437457:0:17224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1e60ef6/0x8ebaae74e82176f5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789478671.437494:0:17224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789478671.437555:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cca3a112-296c-4f03-abf1-9544e970264f+8:2396:x1876403945608576:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 207us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789478671.437562:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 21 00010000:00010000:0.0:1789478671.438507:0:18751:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e1e60ef6/0x8ebaae74e82176f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.438543:0:18751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1e60ef6/0x8ebaae74e82176f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789478671.453981:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1789478671.454132:0:18753:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789478671.454141:0:18753:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1789478671.454790:0:18753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403945608448 00000100:00100000:3.0:1789478671.454799:0:18753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403945608448 00000100:00100000:2.0:1789478671.456552:0:20377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 1 00000100:00100000:2.0:1789478671.456568:0:20377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cca3a112-296c-4f03-abf1-9544e970264f+9:2397:x1876403945608448:12345-192.168.206.11@tcp:4:dd.0 00010000:00010000:2.0:1789478671.456722:0:20377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090b101f7/0x8ebaae74e82176fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.456751:0:20377:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478671.456755:0:20377:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789478671.456761:0:20377:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090b101f7/0x8ebaae74e82176fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.456774:0:20377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090b101f7/0x8ebaae74e82176fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789478671.537437:0:19559:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1789478671.537452:0:19559:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:0.0:1789478671.538364:0:18751:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1789478671.538369:0:18751:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1789478669 -> 1789478670 00002000:00010000:0.0:1789478671.538372:0:18751:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789478669 -> 1789478670 00002000:00010000:0.0:1789478671.538374:0:18751:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:0.0:1789478671.538389:0:18751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1e60ef6/0x8ebaae74e82176f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.538401:0:18751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1e60ef6/0x8ebaae74e82176f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.538408:0:18751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1e60ef6/0x8ebaae74e82176f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.538428:0:18751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc40f04e00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:0.0:1789478671.538433:0:18751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1e60ef6/0x8ebaae74e82176f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.538441:0:18751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1e60ef6/0x8ebaae74e82176f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.538459:0:18751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1e60ef6/0x8ebaae74e82176f5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789478671.538466:0:18751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1e60ef6/0x8ebaae74e82176f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789478671.542159:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cca3a112-296c-4f03-abf1-9544e970264f+9:2397:x1876403945608320:12345-192.168.206.11@tcp:4:dd.0 Request processed in 109457us (109701us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789478671.542172:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 0 00000001:00080000:3.0:1789478671.556444:0:19559:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1789478671.557351:0:20377:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1789478671.557358:0:20377:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1789478671.557374:0:20377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090b101f7/0x8ebaae74e82176fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.557386:0:20377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090b101f7/0x8ebaae74e82176fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.557395:0:20377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090b101f7/0x8ebaae74e82176fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.557402:0:20377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ebc08c4ac00 already unused, calling callback (ffffffffc0d672a0) 00010000:00010000:2.0:1789478671.557407:0:20377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090b101f7/0x8ebaae74e82176fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.557416:0:20377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090b101f7/0x8ebaae74e82176fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.557453:0:20377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090b101f7/0x8ebaae74e82176fc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789478671.557461:0:20377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090b101f7/0x8ebaae74e82176fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789478671.557814:0:20377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cca3a112-296c-4f03-abf1-9544e970264f+5:2397:x1876403945608448:12345-192.168.206.11@tcp:4:dd.0 Request processed in 101245us (103835us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789478671.557825:0:20377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 1 00000100:00100000:0.0:1789478671.588770:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb04487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964542336:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789478671.588806:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789478671.588842:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478671.588915:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964542336 00000100:00100000:2.0:1789478671.588923:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964542336 00000100:00100000:2.0:1789478671.588977:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789478671.588987:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964542336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789478671.589015:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1789478671.589079:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964542336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789478671.589086:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789478671.590735:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb04487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964542336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789478672.101430:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964542464:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789478672.101504:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789478672.101572:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964542464 00000100:00100000:2.0:1789478672.101580:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964542464 00000100:00100000:2.0:1789478672.101664:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789478672.101674:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03feca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964542464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789478672.101706:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789478672.101768:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03feca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876403964542464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478672.101880:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876403964542464:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789478672.102430:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789478672.613188:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789478672.613208:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc08884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d53a32c3-7c45-4781-893e-f633d5432f2d:3646:1876403964542592:0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.613270:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789478672.613277:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478672.613283:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964542720:0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.613327:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478672.613329:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964542592 00000100:00100000:0.0:1789478672.613336:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964542592 00000100:00100000:1.0:1789478672.613364:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964542720 00000100:00100000:1.0:1789478672.613370:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964542720 00000100:00100000:0.0:1789478672.613384:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789478672.613403:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc3c95e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+24:3646:x1876403964542592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.613417:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789478672.613426:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964542720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478672.613458:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc3c95e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d53a32c3-7c45-4781-893e-f633d5432f2d+24:3646:x1876403964542592:12345-0@lo:400:kworker.0 Request processed in 58us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478672.613467:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789478672.613478:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964542720:12345-0@lo:400:kworker.0 Request processed in 52us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478672.613486:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789478672.613511:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789478672.613557:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964542720:0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.613617:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964542848:0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.613645:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478672.613654:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc08884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d53a32c3-7c45-4781-893e-f633d5432f2d:3646:1876403964542592:0@lo:400:kworker.0 00000100:00100000:0.0:1789478672.613681:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964542848 00000100:00100000:0.0:1789478672.613684:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964542848 00000100:00100000:1.0:1789478672.613701:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876403964542976:0@lo:400:kworker.0 00000100:00100000:0.0:1789478672.613725:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789478672.613737:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964542848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.613738:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478672.613784:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964542848:12345-0@lo:400:kworker.0 Request processed in 50us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478672.613788:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000100:00100000:0.0:1789478672.613794:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:1.0:1789478672.613796:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ebb04484000, transno 8589934596 00000004:00080000:1.0:1789478672.613810:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1789478672.613826:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964542848:0@lo:400:kworker.0 00010000:00010000:1.0:1789478672.613963:0:18393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789478672.614007:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789478672.614015:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964543104:0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.614040:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478672.614070:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964543104 00000100:00100000:1.0:1789478672.614074:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964543104 00000100:00100000:1.0:1789478672.614103:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789478672.614110:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc40ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964543104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.614157:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc40ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964543104:12345-0@lo:400:kworker.0 Request processed in 42us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478672.614163:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789478672.614192:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964543104:0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.614222:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964543232:0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.614246:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478672.614706:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964543232 00000100:00100000:1.0:1789478672.614710:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964543232 00000100:00100000:1.0:1789478672.614736:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789478672.614743:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964543232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.614778:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876403964543232:12345-0@lo:400:kworker.0 Request processed in 36us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478672.614784:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789478672.614810:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876403964543232:0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.614844:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964543360:0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.614868:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478672.614894:0:19341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964543360 00000100:00100000:1.0:1789478672.614898:0:19341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964543360 00000100:00100000:1.0:1789478672.615074:0:19341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789478672.615082:0:19341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964543360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.615118:0:19341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876403964543360:12345-0@lo:400:kworker.0 Request processed in 38us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478672.615124:0:19341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789478672.615140:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789478672.615166:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876403964543360:0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.615206:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876403964543488:0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.615231:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478672.615270:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789478672.615276:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876403964543616:0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.615299:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478672.615340:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876403964543744:0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.615365:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478672.615391:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964542976 00000100:00100000:1.0:1789478672.615396:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964542976 00000100:00100000:1.0:1789478672.615644:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964543488 00000100:00100000:1.0:1789478672.615648:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964543488 00000100:00100000:1.0:1789478672.615659:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964543616 00000100:00100000:1.0:1789478672.615662:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964543616 00000100:00100000:1.0:1789478672.615680:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964543744 00000100:00100000:1.0:1789478672.615684:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964543744 00000100:00100000:1.0:1789478672.615697:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789478672.615703:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876403964542976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.615737:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876403964542976:12345-0@lo:400:kworker.0 Request processed in 34us (2003us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478672.615742:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789478672.615754:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789478672.615759:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876403964543488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.615781:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876403964543488:12345-0@lo:400:kworker.0 Request processed in 22us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478672.615787:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789478672.615796:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789478672.615801:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876403964543616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.615835:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876403964543616:12345-0@lo:400:kworker.0 Request processed in 34us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478672.615840:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789478672.615852:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789478672.615857:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876403964543744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.615878:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876403964543744:12345-0@lo:400:kworker.0 Request processed in 22us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478672.615883:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1789478672.615897:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789478672.615900:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789478672.615914:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876403964543488:0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.616011:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876403964542976:0@lo:400:kworker.0 00010000:00080000:1.0:1789478672.616037:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03fef480 x1876403964543744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478672.616048:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876403964543744:0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.616056:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876403964543616:0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.616177:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789478672.616184:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03ffea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876403964543872:0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.616210:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789478672.616233:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964543872 00000100:00100000:1.0:1789478672.616237:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964543872 00000100:00100000:1.0:1789478672.616280:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789478672.616287:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03fef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876403964543872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.616318:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03fef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876403964543872:12345-0@lo:400:kworker.0 Request processed in 32us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789478672.616332:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789478672.616359:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03ffea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876403964543872:0@lo:400:kworker.0 00000100:00100000:1.0:1789478672.616389:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876403964544000:0@lo:400:kworker.0 00000100:00080000:0.0:1789478672.616554:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789478672.616931:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964544128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789478672.616965:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478672.616999:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789478672.617004:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964544256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789478672.617039:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478672.617064:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964544128 00000100:00100000:0.0:1789478672.617068:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964544128 00000100:00100000:0.0:1789478672.617088:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964544256 00000100:00100000:0.0:1789478672.617090:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964544256 00000100:00100000:0.0:1789478672.617102:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789478672.617108:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964544128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789478672.617122:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789478672.617160:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876403964544128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478672.617297:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789478672.617313:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789478672.617321:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964544256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789478672.617331:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:0.0:1789478672.617359:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876403964544256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478672.617365:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789478672.617381:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ebc3c960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964544384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789478672.617403:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478672.617427:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964544384 00000100:00100000:0.0:1789478672.617431:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964544384 00000100:00100000:0.0:1789478672.617446:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789478672.617452:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebc08887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964544384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789478672.617468:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:0.0:1789478672.617497:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebc08887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876403964544384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478672.617503:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789478672.617542:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876403964544384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789478672.617569:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876403964544256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789478672.617580:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebc3c961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876403964544128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789478672.617641:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789478672.618257:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876403964544000 00000100:00100000:0.0:1789478672.618263:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876403964544000 00000100:00100000:0.0:1789478672.618320:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789478672.618328:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ebb03ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876403964544000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789478672.618380:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ebb03ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876403964544000:12345-0@lo:400:kworker.0 Request processed in 53us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789478672.618387:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1789478672.618428:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789478672.618456:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ebb03fed500 x1876403964544000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789478688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789478672.618468:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ebb03fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876403964544000:0@lo:400:kworker.0 00000040:00080000:1.0:1789478672.809638:0:17992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1789478673.028355:0:20414:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1789478673.636951:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 40792 lines, 40792 kept, 0 dropped, 0 bad.